Nov 30 07:02:39 user nova-compute[75293]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75293) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 30 07:02:39 user nova-compute[75293]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75293) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 30 07:02:39 user nova-compute[75293]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75293) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 30 07:02:39 user nova-compute[75293]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 30 07:02:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:02:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:02:39 user nova-compute[75293]: INFO nova.virt.driver [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 30 07:02:40 user nova-compute[75293]: INFO nova.compute.provider_config [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] Acquiring lock "singleton_lock" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] Acquired lock "singleton_lock" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] Releasing lock "singleton_lock" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] Full set of CONF: {{(pid=75293) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ******************************************************************************** {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] Configuration options gathered from: {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ================================================================================ {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] allow_resize_to_same_host      = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] arq_binding_timeout            = 300 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] backdoor_port                  = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] backdoor_socket                = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] block_device_allocate_retries  = 300 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] block_device_allocate_retries_interval = 5 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cert                           = self.pem {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] compute_monitors               = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] config_dir                     = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] config_drive_format            = iso9660 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] config_source                  = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] console_host                   = user {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] control_exchange               = nova {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cpu_allocation_ratio           = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] daemon                         = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] debug                          = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] default_access_ip_network_name = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] default_availability_zone      = nova {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] default_ephemeral_format       = ext4 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] default_green_pool_size        = 1000 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] default_schedule_zone          = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] disk_allocation_ratio          = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] enable_new_services            = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] enabled_ssl_apis               = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] flat_injected                  = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] force_config_drive             = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] force_raw_images               = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] graceful_shutdown_timeout      = 5 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] heal_instance_info_cache_interval = 60 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] host                           = user {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] instance_build_timeout         = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] instance_delete_interval       = 300 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] instance_name_template         = instance-%08x {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] instance_usage_audit           = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] instance_usage_audit_period    = month {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] internal_service_availability_zone = internal {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] key                            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] live_migration_retry_count     = 30 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] log_config_append              = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] log_dir                        = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] log_file                       = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] log_options                    = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] log_rotate_interval            = 1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] log_rotate_interval_type       = days {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] log_rotation_type              = none {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] long_rpc_timeout               = 1800 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] max_concurrent_builds          = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] max_concurrent_live_migrations = 1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] max_concurrent_snapshots       = 5 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] max_local_block_devices        = 3 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] max_logfile_count              = 30 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] max_logfile_size_mb            = 200 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] maximum_instance_delete_attempts = 5 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] metadata_listen                = 0.0.0.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] metadata_listen_port           = 8775 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] metadata_workers               = 3 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] migrate_max_retries            = -1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] mkisofs_cmd                    = genisoimage {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] my_ip                          = 10.0.0.210 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] network_allocate_retries       = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] osapi_compute_listen_port      = 8774 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] osapi_compute_unique_server_name_scope =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] osapi_compute_workers          = 3 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] password_length                = 12 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] periodic_enable                = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] periodic_fuzzy_delay           = 60 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] pointer_model                  = ps2mouse {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] preallocate_images             = none {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] publish_errors                 = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] pybasedir                      = /opt/stack/nova {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ram_allocation_ratio           = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] rate_limit_burst               = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] rate_limit_except_level        = CRITICAL {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] rate_limit_interval            = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] reboot_timeout                 = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] reclaim_instance_interval      = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] record                         = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] reimage_timeout_per_gb         = 60 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] report_interval                = 120 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] rescue_timeout                 = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] reserved_host_cpus             = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] reserved_host_disk_mb          = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] reserved_host_memory_mb        = 512 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] reserved_huge_pages            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] resize_confirm_window          = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] resize_fs_using_block_device   = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] resume_guests_state_on_host_boot = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] rpc_response_timeout           = 60 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] run_external_periodic_tasks    = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] running_deleted_instance_action = reap {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] running_deleted_instance_timeout = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] scheduler_instance_sync_interval = 120 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] service_down_time              = 720 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] servicegroup_driver            = db {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] shelved_offload_time           = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] shelved_poll_interval          = 3600 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] shutdown_timeout               = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] source_is_ipv6                 = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ssl_only                       = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] state_path                     = /opt/stack/data/nova {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] sync_power_state_interval      = 600 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] sync_power_state_pool_size     = 1000 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] syslog_log_facility            = LOG_USER {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] tempdir                        = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] timeout_nbd                    = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] transport_url                  = **** {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] update_resources_interval      = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] use_cow_images                 = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] use_eventlog                   = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] use_journal                    = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] use_json                       = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] use_rootwrap_daemon            = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] use_stderr                     = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] use_syslog                     = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vcpu_pin_set                   = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vif_plugging_is_fatal          = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vif_plugging_timeout           = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] virt_mkfs                      = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] volume_usage_poll_interval     = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] watch_log_file                 = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] web                            = /usr/share/spice-html5 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_concurrency.disable_process_locking = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.auth_strategy              = keystone {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.compute_link_prefix        = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.dhcp_domain                = novalocal {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.enable_instance_password   = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.glance_link_prefix         = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.instance_list_per_project_cells = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.list_records_by_skipping_down_cells = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.local_metadata_per_cell    = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.max_limit                  = 1000 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.metadata_cache_expiration  = 15 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.neutron_default_tenant_id  = default {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.use_forwarded_for          = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.use_neutron_default_nets   = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.vendordata_dynamic_targets = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.vendordata_jsonfile_path   = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.backend_argument         = **** {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.config_prefix            = cache.oslo {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.dead_timeout             = 60.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.debug_cache_backend      = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.enable_retry_client      = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.enable_socket_keepalive  = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.enabled                  = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.expiration_time          = 600 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.hashclient_retry_attempts = 2 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.memcache_dead_retry      = 300 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.memcache_password        =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.memcache_sasl_enabled    = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.memcache_username        =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.proxies                  = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.retry_attempts           = 2 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.retry_delay              = 0.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.socket_keepalive_count   = 1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.socket_keepalive_idle    = 1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.socket_keepalive_interval = 1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.tls_allowed_ciphers      = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.tls_cafile               = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.tls_certfile             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.tls_enabled              = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cache.tls_keyfile              = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cinder.auth_section            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cinder.auth_type               = password {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cinder.cafile                  = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cinder.certfile                = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cinder.collect_timing          = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cinder.cross_az_attach         = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cinder.debug                   = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cinder.endpoint_template       = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cinder.http_retries            = 3 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cinder.insecure                = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cinder.keyfile                 = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cinder.os_region_name          = RegionOne {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cinder.split_loggers           = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cinder.timeout                 = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] compute.cpu_dedicated_set      = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] compute.cpu_shared_set         = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] compute.image_type_exclude_list = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] compute.resource_provider_association_refresh = 300 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] compute.shutdown_retry_interval = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] conductor.workers              = 3 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] console.allowed_origins        = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] console.ssl_ciphers            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] console.ssl_minimum_version    = default {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] consoleauth.token_ttl          = 600 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cyborg.cafile                  = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cyborg.certfile                = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cyborg.collect_timing          = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cyborg.connect_retries         = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cyborg.connect_retry_delay     = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cyborg.endpoint_override       = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cyborg.insecure                = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cyborg.keyfile                 = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cyborg.max_version             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cyborg.min_version             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cyborg.region_name             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cyborg.service_name            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cyborg.service_type            = accelerator {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cyborg.split_loggers           = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cyborg.status_code_retries     = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cyborg.status_code_retry_delay = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cyborg.timeout                 = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] cyborg.version                 = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] database.backend               = sqlalchemy {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] database.connection            = **** {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] database.connection_debug      = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] database.connection_parameters =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] database.connection_recycle_time = 3600 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] database.connection_trace      = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] database.db_inc_retry_interval = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] database.db_max_retries        = 20 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] database.db_max_retry_interval = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] database.db_retry_interval     = 1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] database.max_overflow          = 50 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] database.max_pool_size         = 5 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] database.max_retries           = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] database.mysql_wsrep_sync_wait = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] database.pool_timeout          = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] database.retry_interval        = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] database.slave_connection      = **** {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] database.sqlite_synchronous    = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api_database.backend           = sqlalchemy {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api_database.connection        = **** {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api_database.connection_debug  = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api_database.connection_parameters =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api_database.connection_recycle_time = 3600 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api_database.connection_trace  = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api_database.db_inc_retry_interval = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api_database.db_max_retries    = 20 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api_database.db_max_retry_interval = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api_database.db_retry_interval = 1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api_database.max_overflow      = 50 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api_database.max_pool_size     = 5 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api_database.max_retries       = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api_database.pool_timeout      = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api_database.retry_interval    = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api_database.slave_connection  = **** {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] api_database.sqlite_synchronous = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] devices.enabled_mdev_types     = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ephemeral_storage_encryption.enabled = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.api_servers             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.cafile                  = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.certfile                = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.collect_timing          = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.connect_retries         = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.connect_retry_delay     = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.debug                   = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.default_trusted_certificate_ids = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.enable_certificate_validation = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.enable_rbd_download     = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.endpoint_override       = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.insecure                = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.keyfile                 = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.max_version             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.min_version             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.num_retries             = 3 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.rbd_ceph_conf           =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.rbd_connect_timeout     = 5 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.rbd_pool                =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.rbd_user                =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.region_name             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.service_name            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.service_type            = image {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.split_loggers           = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.status_code_retries     = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.status_code_retry_delay = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.timeout                 = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.verify_glance_signatures = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] glance.version                 = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] guestfs.debug                  = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] hyperv.config_drive_cdrom      = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] hyperv.config_drive_inject_password = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] hyperv.enable_remotefx         = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] hyperv.instances_path_share    =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] hyperv.limit_cpu_features      = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] hyperv.use_multipath_io        = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] hyperv.vswitch_name            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] mks.enabled                    = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] image_cache.manager_interval   = 2400 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] image_cache.precache_concurrency = 1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] image_cache.remove_unused_base_images = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] image_cache.subdirectory_name  = _base {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.api_max_retries         = 60 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.api_retry_interval      = 2 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.auth_section            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.auth_type               = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.cafile                  = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.certfile                = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.collect_timing          = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.conductor_group         = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.connect_retries         = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.connect_retry_delay     = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.endpoint_override       = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.insecure                = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.keyfile                 = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.max_version             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.min_version             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.peer_list               = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.region_name             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.serial_console_state_timeout = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.service_name            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.service_type            = baremetal {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.split_loggers           = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.status_code_retries     = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.status_code_retry_delay = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.timeout                 = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ironic.version                 = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] key_manager.fixed_key          = **** {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican.barbican_api_version  = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican.barbican_endpoint     = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican.barbican_endpoint_type = public {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican.barbican_region_name  = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican.cafile                = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican.certfile              = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican.collect_timing        = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican.insecure              = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican.keyfile               = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican.number_of_retries     = 60 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican.retry_delay           = 1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican.send_service_user_token = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican.split_loggers         = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican.timeout               = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican.verify_ssl            = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican.verify_ssl_path       = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican_service_user.auth_section = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican_service_user.auth_type = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican_service_user.cafile   = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican_service_user.certfile = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican_service_user.collect_timing = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican_service_user.insecure = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican_service_user.keyfile  = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican_service_user.split_loggers = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] barbican_service_user.timeout  = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vault.approle_role_id          = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vault.approle_secret_id        = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vault.cafile                   = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vault.certfile                 = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vault.collect_timing           = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vault.insecure                 = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vault.keyfile                  = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vault.kv_mountpoint            = secret {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vault.kv_path                  = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vault.kv_version               = 2 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vault.namespace                = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vault.root_token_id            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vault.split_loggers            = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vault.ssl_ca_crt_file          = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vault.timeout                  = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vault.use_ssl                  = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.auth_section          = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.auth_type             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.cafile                = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.certfile              = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.collect_timing        = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.connect_retries       = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.connect_retry_delay   = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.endpoint_override     = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.insecure              = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.keyfile               = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.max_version           = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.min_version           = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.region_name           = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.service_name          = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.service_type          = identity {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.split_loggers         = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.status_code_retries   = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.status_code_retry_delay = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.timeout               = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] keystone.version               = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.connection_uri         =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.cpu_mode               = custom {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: WARNING oslo_config.cfg [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.cpu_power_governor_high = performance {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.cpu_power_management   = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.device_detach_attempts = 8 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.device_detach_timeout  = 20 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.disk_cachemodes        = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.disk_prefix            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.enabled_perf_events    = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.file_backed_memory     = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.gid_maps               = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.hw_disk_discard        = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.hw_machine_type        = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.images_rbd_pool        = rbd {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.images_type            = default {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.images_volume_group    = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.inject_key             = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.inject_partition       = -2 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.inject_password        = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.iscsi_iface            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.iser_use_multipath     = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.live_migration_downtime = 500 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.live_migration_inbound_addr = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.live_migration_scheme  = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.live_migration_timeout_action = abort {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.live_migration_tunnelled = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: WARNING oslo_config.cfg [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 30 07:02:40 user nova-compute[75293]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 30 07:02:40 user nova-compute[75293]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 30 07:02:40 user nova-compute[75293]: and ``live_migration_inbound_addr`` respectively.
Nov 30 07:02:40 user nova-compute[75293]: ).  Its value may be silently ignored in the future.
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.live_migration_with_native_tls = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.max_queues             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.nfs_mount_options      = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.num_pcie_ports         = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.pmem_namespaces        = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.quobyte_client_cfg     = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.rbd_secret_uuid        = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.rbd_user               = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.rescue_image_id        = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.rescue_kernel_id       = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.rx_queue_size          = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.smbfs_mount_options    =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.snapshot_compression   = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.snapshot_image_format  = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.sparse_logical_volumes = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.swtpm_enabled          = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.swtpm_group            = tss {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.swtpm_user             = tss {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.sysinfo_serial         = unique {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.tb_cache_size          = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.tx_queue_size          = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.uid_maps               = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.use_virtio_for_bridges = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.virt_type              = kvm {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.volume_clear           = zero {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.volume_clear_size      = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.volume_use_multipath   = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.vzstorage_cache_path   = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.auth_section           = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.auth_type              = password {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.cafile                 = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.certfile               = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.collect_timing         = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.connect_retries        = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.connect_retry_delay    = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.default_floating_pool  = public {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.endpoint_override      = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.extension_sync_interval = 600 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.http_retries           = 3 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.insecure               = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.keyfile                = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.max_version            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.min_version            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.ovs_bridge             = br-int {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.physnets               = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.region_name            = RegionOne {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.service_metadata_proxy = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.service_name           = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.service_type           = network {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.split_loggers          = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.status_code_retries    = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.status_code_retry_delay = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.timeout                = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] neutron.version                = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] notifications.bdms_in_notifications = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] notifications.default_level    = INFO {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] notifications.notification_format = unversioned {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] notifications.notify_on_state_change = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] pci.alias                      = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] pci.device_spec                = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] pci.report_in_placement        = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.auth_section         = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.auth_type            = password {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.cafile               = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.certfile             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.collect_timing       = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.connect_retries      = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.connect_retry_delay  = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.default_domain_id    = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.default_domain_name  = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.domain_id            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.domain_name          = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.endpoint_override    = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.insecure             = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.keyfile              = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.max_version          = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.min_version          = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.password             = **** {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.project_domain_id    = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.project_domain_name  = Default {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.project_id           = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.project_name         = service {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.region_name          = RegionOne {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.service_name         = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.service_type         = placement {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.split_loggers        = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.status_code_retries  = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.status_code_retry_delay = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.system_scope         = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.timeout              = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.trust_id             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.user_domain_id       = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.user_domain_name     = Default {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.user_id              = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.username             = placement {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] placement.version              = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] quota.cores                    = 20 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] quota.count_usage_from_placement = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] quota.injected_file_content_bytes = 10240 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] quota.injected_file_path_length = 255 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] quota.injected_files           = 5 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] quota.instances                = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] quota.key_pairs                = 100 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] quota.metadata_items           = 128 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] quota.ram                      = 51200 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] quota.recheck_quota            = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] quota.server_group_members     = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] quota.server_groups            = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] rdp.enabled                    = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] scheduler.image_metadata_prefilter = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] scheduler.max_attempts         = 3 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] scheduler.max_placement_results = 1000 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] scheduler.workers              = 3 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.host_subset_size = 1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.isolated_hosts = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.isolated_images = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.pci_in_placement = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.track_instance_changes = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] metrics.required               = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] metrics.weight_multiplier      = 1.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] metrics.weight_setting         = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] serial_console.enabled         = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] serial_console.port_range      = 10000:20000 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] serial_console.serialproxy_port = 6083 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] service_user.auth_section      = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] service_user.auth_type         = password {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] service_user.cafile            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] service_user.certfile          = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] service_user.collect_timing    = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] service_user.insecure          = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] service_user.keyfile           = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] service_user.send_service_user_token = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] service_user.split_loggers     = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] service_user.timeout           = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] spice.agent_enabled            = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] spice.enabled                  = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] spice.html5proxy_port          = 6082 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] spice.image_compression        = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] spice.jpeg_compression         = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] spice.playback_compression     = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] spice.server_listen            = 127.0.0.1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] spice.streaming_mode           = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] spice.zlib_compression         = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] upgrade_levels.baseapi         = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] upgrade_levels.compute         = auto {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] upgrade_levels.conductor       = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] upgrade_levels.scheduler       = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vendordata_dynamic_auth.cafile = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vendordata_dynamic_auth.certfile = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vendordata_dynamic_auth.insecure = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vendordata_dynamic_auth.timeout = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.api_retry_count         = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.ca_file                 = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.cache_prefix            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.cluster_name            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.connection_pool_size    = 10 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.console_delay_seconds   = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.datastore_regex         = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.host_ip                 = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.host_password           = **** {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.host_port               = 443 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.host_username           = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.insecure                = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.integration_bridge      = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.maximum_objects         = 100 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.pbm_default_policy      = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.pbm_enabled             = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.pbm_wsdl_location       = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.serial_port_proxy_uri   = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.serial_port_service_uri = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.task_poll_interval      = 0.5 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.use_linked_clone        = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.vnc_keymap              = en-us {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.vnc_port                = 5900 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vmware.vnc_port_total          = 10000 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vnc.auth_schemes               = ['none'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vnc.enabled                    = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vnc.novncproxy_port            = 6080 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vnc.vencrypt_ca_certs          = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vnc.vencrypt_client_cert       = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vnc.vencrypt_client_key        = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.disable_rootwrap   = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.enable_numa_live_migration = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.libvirt_disable_apic = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] wsgi.client_socket_timeout     = 900 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] wsgi.default_pool_size         = 1000 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] wsgi.keep_alive                = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] wsgi.max_header_line           = 16384 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] wsgi.ssl_ca_file               = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] wsgi.ssl_cert_file             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] wsgi.ssl_key_file              = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] wsgi.tcp_keepidle              = 600 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] zvm.ca_file                    = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] zvm.cloud_connector_url        = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] zvm.reachable_timeout          = 300 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_policy.enforce_new_defaults = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_policy.enforce_scope      = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_policy.policy_default_rule = default {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] profiler.connection_string     = messaging:// {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] profiler.enabled               = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] profiler.es_doc_type           = notification {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] profiler.es_scroll_size        = 10000 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] profiler.es_scroll_time        = 2m {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] profiler.filter_error_trace    = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] profiler.hmac_keys             = **** {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] profiler.sentinel_service_name = mymaster {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] profiler.socket_timeout        = 0.1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] profiler.trace_requests        = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] profiler.trace_sqlalchemy      = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] profiler_jaeger.process_tags   = {} {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] profiler_jaeger.service_name_prefix = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] profiler_otlp.service_name_prefix = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] remote_debug.host              = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] remote_debug.port              = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_notifications.retry = -1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.auth_section        = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.auth_type           = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.cafile              = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.certfile            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.collect_timing      = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.connect_retries     = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.connect_retry_delay = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.endpoint_id         = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.endpoint_override   = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.insecure            = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.keyfile             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.max_version         = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.min_version         = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.region_name         = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.service_name        = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.service_type        = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.split_loggers       = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.status_code_retries = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.status_code_retry_delay = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.timeout             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.valid_interfaces    = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_limit.version             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_reports.file_event_handler = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] oslo_reports.log_dir           = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vif_plug_ovs_privileged.group  = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] vif_plug_ovs_privileged.user   = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] os_vif_ovs.isolate_vif         = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] os_brick.lock_path             = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] privsep_osbrick.capabilities   = [21] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] privsep_osbrick.group          = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] privsep_osbrick.helper_command = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] privsep_osbrick.user           = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] nova_sys_admin.group           = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] nova_sys_admin.helper_command  = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] nova_sys_admin.user            = None {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG oslo_service.service [None req-2749e999-c79d-4b23-8cfa-85e45f301cb8 None None] ******************************************************************************** {{(pid=75293) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 30 07:02:40 user nova-compute[75293]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 30 07:02:40 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Connecting to libvirt: qemu:///system {{(pid=75293) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7effe90ae3e0> {{(pid=75293) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 30 07:02:40 user nova-compute[75293]: libvirt:  error : internal error: could not initialize domain event timer
Nov 30 07:02:40 user nova-compute[75293]: WARNING nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 30 07:02:40 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7effe90ae3e0> {{(pid=75293) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Starting native event thread {{(pid=75293) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Starting green dispatch thread {{(pid=75293) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 30 07:02:40 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Starting connection event dispatch thread {{(pid=75293) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 30 07:02:40 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Connection event '1' reason 'None'
Nov 30 07:02:40 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 30 07:02:40 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.mount [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Initialising _HostMountState generation 0 {{(pid=75293) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 30 07:02:47 user nova-compute[75293]: INFO nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Libvirt host capabilities <capabilities>
Nov 30 07:02:47 user nova-compute[75293]:   <host>
Nov 30 07:02:47 user nova-compute[75293]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 30 07:02:47 user nova-compute[75293]:     <cpu>
Nov 30 07:02:47 user nova-compute[75293]:       <arch>x86_64</arch>
Nov 30 07:02:47 user nova-compute[75293]:       <model>IvyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <vendor>Intel</vendor>
Nov 30 07:02:47 user nova-compute[75293]:       <microcode version='1070'/>
Nov 30 07:02:47 user nova-compute[75293]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 30 07:02:47 user nova-compute[75293]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature name='ss'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature name='vmx'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature name='pcid'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature name='osxsave'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature name='hypervisor'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature name='arat'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature name='tsc_adjust'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature name='md-clear'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature name='stibp'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature name='arch-capabilities'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature name='ssbd'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature name='invtsc'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature name='rsba'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature name='skip-l1dfl-vmentry'/>
Nov 30 07:02:47 user nova-compute[75293]:       <pages unit='KiB' size='4'/>
Nov 30 07:02:47 user nova-compute[75293]:       <pages unit='KiB' size='2048'/>
Nov 30 07:02:47 user nova-compute[75293]:     </cpu>
Nov 30 07:02:47 user nova-compute[75293]:     <power_management>
Nov 30 07:02:47 user nova-compute[75293]:       <suspend_mem/>
Nov 30 07:02:47 user nova-compute[75293]:       <suspend_disk/>
Nov 30 07:02:47 user nova-compute[75293]:       <suspend_hybrid/>
Nov 30 07:02:47 user nova-compute[75293]:     </power_management>
Nov 30 07:02:47 user nova-compute[75293]:     <iommu support='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     <migration_features>
Nov 30 07:02:47 user nova-compute[75293]:       <live/>
Nov 30 07:02:47 user nova-compute[75293]:       <uri_transports>
Nov 30 07:02:47 user nova-compute[75293]:         <uri_transport>tcp</uri_transport>
Nov 30 07:02:47 user nova-compute[75293]:         <uri_transport>rdma</uri_transport>
Nov 30 07:02:47 user nova-compute[75293]:       </uri_transports>
Nov 30 07:02:47 user nova-compute[75293]:     </migration_features>
Nov 30 07:02:47 user nova-compute[75293]:     <topology>
Nov 30 07:02:47 user nova-compute[75293]:       <cells num='2'>
Nov 30 07:02:47 user nova-compute[75293]:         <cell id='0'>
Nov 30 07:02:47 user nova-compute[75293]:           <memory unit='KiB'>8189224</memory>
Nov 30 07:02:47 user nova-compute[75293]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 30 07:02:47 user nova-compute[75293]:           <pages unit='KiB' size='2048'>0</pages>
Nov 30 07:02:47 user nova-compute[75293]:           <distances>
Nov 30 07:02:47 user nova-compute[75293]:             <sibling id='0' value='10'/>
Nov 30 07:02:47 user nova-compute[75293]:             <sibling id='1' value='20'/>
Nov 30 07:02:47 user nova-compute[75293]:           </distances>
Nov 30 07:02:47 user nova-compute[75293]:           <cpus num='6'>
Nov 30 07:02:47 user nova-compute[75293]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 30 07:02:47 user nova-compute[75293]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 30 07:02:47 user nova-compute[75293]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 30 07:02:47 user nova-compute[75293]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 30 07:02:47 user nova-compute[75293]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 30 07:02:47 user nova-compute[75293]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 30 07:02:47 user nova-compute[75293]:           </cpus>
Nov 30 07:02:47 user nova-compute[75293]:         </cell>
Nov 30 07:02:47 user nova-compute[75293]:         <cell id='1'>
Nov 30 07:02:47 user nova-compute[75293]:           <memory unit='KiB'>8206460</memory>
Nov 30 07:02:47 user nova-compute[75293]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 30 07:02:47 user nova-compute[75293]:           <pages unit='KiB' size='2048'>0</pages>
Nov 30 07:02:47 user nova-compute[75293]:           <distances>
Nov 30 07:02:47 user nova-compute[75293]:             <sibling id='0' value='20'/>
Nov 30 07:02:47 user nova-compute[75293]:             <sibling id='1' value='10'/>
Nov 30 07:02:47 user nova-compute[75293]:           </distances>
Nov 30 07:02:47 user nova-compute[75293]:           <cpus num='6'>
Nov 30 07:02:47 user nova-compute[75293]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 30 07:02:47 user nova-compute[75293]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 30 07:02:47 user nova-compute[75293]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 30 07:02:47 user nova-compute[75293]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 30 07:02:47 user nova-compute[75293]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 30 07:02:47 user nova-compute[75293]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 30 07:02:47 user nova-compute[75293]:           </cpus>
Nov 30 07:02:47 user nova-compute[75293]:         </cell>
Nov 30 07:02:47 user nova-compute[75293]:       </cells>
Nov 30 07:02:47 user nova-compute[75293]:     </topology>
Nov 30 07:02:47 user nova-compute[75293]:     <cache>
Nov 30 07:02:47 user nova-compute[75293]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 30 07:02:47 user nova-compute[75293]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 30 07:02:47 user nova-compute[75293]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 30 07:02:47 user nova-compute[75293]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 30 07:02:47 user nova-compute[75293]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 30 07:02:47 user nova-compute[75293]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 30 07:02:47 user nova-compute[75293]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 30 07:02:47 user nova-compute[75293]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 30 07:02:47 user nova-compute[75293]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 30 07:02:47 user nova-compute[75293]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 30 07:02:47 user nova-compute[75293]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 30 07:02:47 user nova-compute[75293]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 30 07:02:47 user nova-compute[75293]:     </cache>
Nov 30 07:02:47 user nova-compute[75293]:     <secmodel>
Nov 30 07:02:47 user nova-compute[75293]:       <model>apparmor</model>
Nov 30 07:02:47 user nova-compute[75293]:       <doi>0</doi>
Nov 30 07:02:47 user nova-compute[75293]:     </secmodel>
Nov 30 07:02:47 user nova-compute[75293]:     <secmodel>
Nov 30 07:02:47 user nova-compute[75293]:       <model>dac</model>
Nov 30 07:02:47 user nova-compute[75293]:       <doi>0</doi>
Nov 30 07:02:47 user nova-compute[75293]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 30 07:02:47 user nova-compute[75293]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 30 07:02:47 user nova-compute[75293]:     </secmodel>
Nov 30 07:02:47 user nova-compute[75293]:   </host>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='alpha'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>64</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>clipper</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='armv6l'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>32</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>integratorcp</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>borzoi</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>spitz</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>nuri</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>musca-b1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>versatileab</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>kzm</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>musca-a</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>smdkc210</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>sx1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>z2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>tosa</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>sabrelite</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>realview-eb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>n810</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>n800</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>versatilepb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>terrier</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mainstone</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>midway</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>musicpal</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>microbit</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>cubieboard</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>verdex</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>netduino2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>raspi2b</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>cheetah</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>highbank</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>akita</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>connex</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>collie</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>raspi0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='armv7l'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>32</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>integratorcp</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>borzoi</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>spitz</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>nuri</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>musca-b1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>versatileab</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>kzm</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>musca-a</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>smdkc210</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>sx1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>z2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>tosa</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>sabrelite</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>realview-eb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>n810</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>n800</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>versatilepb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>terrier</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mainstone</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>midway</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>musicpal</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>microbit</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>cubieboard</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>verdex</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>netduino2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>raspi2b</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>cheetah</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>highbank</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>akita</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>connex</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>collie</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>raspi0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='aarch64'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>64</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>integratorcp</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>borzoi</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>spitz</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>nuri</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>musca-b1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>versatileab</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>kzm</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>musca-a</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>smdkc210</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>sx1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>z2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>tosa</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>sabrelite</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>realview-eb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>n810</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>n800</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>versatilepb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>terrier</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mainstone</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>midway</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>musicpal</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>microbit</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>cubieboard</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>verdex</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>netduino2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>raspi3b</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>raspi2b</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>cheetah</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>highbank</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>akita</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>connex</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>collie</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>raspi0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <acpi default='on' toggle='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='cris'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>32</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='i686'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>32</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>x-remote</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>isapc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>microvm</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='kvm'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <pae/>
Nov 30 07:02:47 user nova-compute[75293]:       <nonpae/>
Nov 30 07:02:47 user nova-compute[75293]:       <acpi default='on' toggle='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:       <apic default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='m68k'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>32</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>an5206</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>q800</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>next-cube</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='microblaze'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>32</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='microblazeel'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>32</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='mips'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>32</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='16'>malta</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='mipsel'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>32</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='16'>malta</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='mips64'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>64</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='16'>malta</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>pica61</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>magnum</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='mips64el'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>64</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='16'>malta</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mipssim</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>pica61</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>magnum</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='16'>boston</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='ppc'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>32</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>g3beige</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mac99</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>ppce500</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>pegasos2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>sam460ex</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>bamboo</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>40p</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>ref405ep</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>taihu</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='ppc64'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>64</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2048'>powernv9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>taihu</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2048'>powernv10</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>ppce500</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>40p</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>pegasos2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>bamboo</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>g3beige</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mac99</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>sam460ex</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>ref405ep</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2048'>powernv8</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='ppc64le'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>64</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2048'>powernv9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>taihu</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2048'>powernv10</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>ppce500</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>40p</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>pegasos2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>bamboo</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>g3beige</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>mac99</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>sam460ex</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>ref405ep</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2048'>powernv8</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='riscv32'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>32</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='8'>spike</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>opentitan</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='5'>sifive_u</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>sifive_e</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='8'>virt</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='riscv64'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>64</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='8'>spike</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='5'>sifive_u</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>shakti_c</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>sifive_e</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='8'>virt</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='s390x'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>64</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='sh4'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>32</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>shix</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>r2d</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='sh4eb'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>64</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>shix</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>r2d</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='sparc'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>32</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>SS-5</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>SS-20</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>LX</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>SS-4</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>SS-10</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>Voyager</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='sparc64'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>64</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>sun4u</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>niagara</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>sun4v</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='x86_64'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>64</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>x-remote</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='1'>isapc</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>microvm</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='kvm'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <acpi default='on' toggle='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:       <apic default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='xtensa'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>32</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>sim</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>kc705</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>ml605</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>virt</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>lx200</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>lx60</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]:   <guest>
Nov 30 07:02:47 user nova-compute[75293]:     <os_type>hvm</os_type>
Nov 30 07:02:47 user nova-compute[75293]:     <arch name='xtensaeb'>
Nov 30 07:02:47 user nova-compute[75293]:       <wordsize>32</wordsize>
Nov 30 07:02:47 user nova-compute[75293]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='4'>sim</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>kc705</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>ml605</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>virt</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>lx200</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>lx60</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 30 07:02:47 user nova-compute[75293]:       <domain type='qemu'/>
Nov 30 07:02:47 user nova-compute[75293]:     </arch>
Nov 30 07:02:47 user nova-compute[75293]:     <features>
Nov 30 07:02:47 user nova-compute[75293]:       <cpuselection/>
Nov 30 07:02:47 user nova-compute[75293]:       <deviceboot/>
Nov 30 07:02:47 user nova-compute[75293]:       <disksnapshot default='on' toggle='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     </features>
Nov 30 07:02:47 user nova-compute[75293]:   </guest>
Nov 30 07:02:47 user nova-compute[75293]: </capabilities>
Nov 30 07:02:47 user nova-compute[75293]: 
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 30 07:02:47 user nova-compute[75293]: <domainCapabilities>
Nov 30 07:02:47 user nova-compute[75293]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 07:02:47 user nova-compute[75293]:   <domain>kvm</domain>
Nov 30 07:02:47 user nova-compute[75293]:   <machine>pc-i440fx-6.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:   <arch>i686</arch>
Nov 30 07:02:47 user nova-compute[75293]:   <vcpu max='255'/>
Nov 30 07:02:47 user nova-compute[75293]:   <iothreads supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:   <os supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:     <enum name='firmware'/>
Nov 30 07:02:47 user nova-compute[75293]:     <loader supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='type'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>rom</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>pflash</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='readonly'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>yes</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>no</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='secure'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>no</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </loader>
Nov 30 07:02:47 user nova-compute[75293]:   </os>
Nov 30 07:02:47 user nova-compute[75293]:   <cpu>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='host-passthrough' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='hostPassthroughMigratable'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>off</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='maximum' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='maximumMigratable'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>on</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>off</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='host-model' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <vendor>Intel</vendor>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ss'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='vmx'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='pcid'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='hypervisor'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='arat'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='umip'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='md-clear'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='stibp'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ssbd'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ibpb'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ibrs'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='amd-stibp'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='erms'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='lm'/>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='custom' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>qemu64</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>qemu32</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>phenom</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium3</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium2</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>n270</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>kvm64</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>kvm32</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>coreduo</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>core2duo</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>athlon</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Westmere</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Snowridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>SandyBridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Penryn</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G5</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G4</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G3</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G2</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G1</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Nehalem</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>IvyBridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Icelake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-Rome</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-Milan</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Dhyana</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cooperlake</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Conroe</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>486</model>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:   </cpu>
Nov 30 07:02:47 user nova-compute[75293]:   <memoryBacking supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:     <enum name='sourceType'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>file</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>anonymous</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>memfd</value>
Nov 30 07:02:47 user nova-compute[75293]:     </enum>
Nov 30 07:02:47 user nova-compute[75293]:   </memoryBacking>
Nov 30 07:02:47 user nova-compute[75293]:   <devices>
Nov 30 07:02:47 user nova-compute[75293]:     <disk supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='diskDevice'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>disk</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>cdrom</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>floppy</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>lun</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='bus'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>ide</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>fdc</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>scsi</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>usb</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>sata</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-non-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </disk>
Nov 30 07:02:47 user nova-compute[75293]:     <graphics supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='type'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>sdl</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vnc</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>spice</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>egl-headless</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </graphics>
Nov 30 07:02:47 user nova-compute[75293]:     <video supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='modelType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vga</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>cirrus</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vmvga</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>qxl</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>none</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>bochs</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>ramfb</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </video>
Nov 30 07:02:47 user nova-compute[75293]:     <hostdev supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='mode'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>subsystem</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='startupPolicy'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>default</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>mandatory</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>requisite</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>optional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='subsysType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>usb</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>pci</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>scsi</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='capsType'/>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='pciBackend'/>
Nov 30 07:02:47 user nova-compute[75293]:     </hostdev>
Nov 30 07:02:47 user nova-compute[75293]:     <rng supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-non-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='backendModel'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>random</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>egd</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>builtin</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </rng>
Nov 30 07:02:47 user nova-compute[75293]:     <filesystem supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='driverType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>path</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>handle</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtiofs</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </filesystem>
Nov 30 07:02:47 user nova-compute[75293]:     <tpm supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>tpm-tis</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>tpm-crb</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='backendModel'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>passthrough</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>emulator</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </tpm>
Nov 30 07:02:47 user nova-compute[75293]:   </devices>
Nov 30 07:02:47 user nova-compute[75293]:   <features>
Nov 30 07:02:47 user nova-compute[75293]:     <gic supported='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     <vmcoreinfo supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <genid supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <backingStoreInput supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <backup supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <sev supported='no'/>
Nov 30 07:02:47 user nova-compute[75293]:   </features>
Nov 30 07:02:47 user nova-compute[75293]: </domainCapabilities>
Nov 30 07:02:47 user nova-compute[75293]:  {{(pid=75293) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 30 07:02:47 user nova-compute[75293]: <domainCapabilities>
Nov 30 07:02:47 user nova-compute[75293]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 07:02:47 user nova-compute[75293]:   <domain>kvm</domain>
Nov 30 07:02:47 user nova-compute[75293]:   <machine>pc-q35-jammy</machine>
Nov 30 07:02:47 user nova-compute[75293]:   <arch>i686</arch>
Nov 30 07:02:47 user nova-compute[75293]:   <vcpu max='288'/>
Nov 30 07:02:47 user nova-compute[75293]:   <iothreads supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:   <os supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:     <enum name='firmware'/>
Nov 30 07:02:47 user nova-compute[75293]:     <loader supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='type'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>rom</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>pflash</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='readonly'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>yes</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>no</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='secure'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>no</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </loader>
Nov 30 07:02:47 user nova-compute[75293]:   </os>
Nov 30 07:02:47 user nova-compute[75293]:   <cpu>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='host-passthrough' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='hostPassthroughMigratable'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>off</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='maximum' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='maximumMigratable'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>on</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>off</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='host-model' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <vendor>Intel</vendor>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ss'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='vmx'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='pcid'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='hypervisor'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='arat'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='umip'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='md-clear'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='stibp'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ssbd'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ibpb'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ibrs'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='amd-stibp'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='erms'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='lm'/>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='custom' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>qemu64</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>qemu32</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>phenom</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium3</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium2</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>n270</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>kvm64</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>kvm32</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>coreduo</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>core2duo</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>athlon</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Westmere</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Snowridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>SandyBridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Penryn</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G5</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G4</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G3</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G2</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G1</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Nehalem</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>IvyBridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Icelake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-Rome</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-Milan</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Dhyana</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cooperlake</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Conroe</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>486</model>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:   </cpu>
Nov 30 07:02:47 user nova-compute[75293]:   <memoryBacking supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:     <enum name='sourceType'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>file</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>anonymous</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>memfd</value>
Nov 30 07:02:47 user nova-compute[75293]:     </enum>
Nov 30 07:02:47 user nova-compute[75293]:   </memoryBacking>
Nov 30 07:02:47 user nova-compute[75293]:   <devices>
Nov 30 07:02:47 user nova-compute[75293]:     <disk supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='diskDevice'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>disk</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>cdrom</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>floppy</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>lun</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='bus'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>fdc</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>scsi</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>usb</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>sata</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-non-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </disk>
Nov 30 07:02:47 user nova-compute[75293]:     <graphics supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='type'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>sdl</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vnc</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>spice</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>egl-headless</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </graphics>
Nov 30 07:02:47 user nova-compute[75293]:     <video supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='modelType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vga</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>cirrus</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vmvga</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>qxl</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>none</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>bochs</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>ramfb</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </video>
Nov 30 07:02:47 user nova-compute[75293]:     <hostdev supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='mode'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>subsystem</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='startupPolicy'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>default</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>mandatory</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>requisite</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>optional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='subsysType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>usb</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>pci</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>scsi</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='capsType'/>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='pciBackend'/>
Nov 30 07:02:47 user nova-compute[75293]:     </hostdev>
Nov 30 07:02:47 user nova-compute[75293]:     <rng supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-non-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='backendModel'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>random</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>egd</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>builtin</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </rng>
Nov 30 07:02:47 user nova-compute[75293]:     <filesystem supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='driverType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>path</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>handle</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtiofs</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </filesystem>
Nov 30 07:02:47 user nova-compute[75293]:     <tpm supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>tpm-tis</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>tpm-crb</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='backendModel'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>passthrough</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>emulator</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </tpm>
Nov 30 07:02:47 user nova-compute[75293]:   </devices>
Nov 30 07:02:47 user nova-compute[75293]:   <features>
Nov 30 07:02:47 user nova-compute[75293]:     <gic supported='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     <vmcoreinfo supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <genid supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <backingStoreInput supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <backup supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <sev supported='no'/>
Nov 30 07:02:47 user nova-compute[75293]:   </features>
Nov 30 07:02:47 user nova-compute[75293]: </domainCapabilities>
Nov 30 07:02:47 user nova-compute[75293]:  {{(pid=75293) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 30 07:02:47 user nova-compute[75293]: <domainCapabilities>
Nov 30 07:02:47 user nova-compute[75293]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 07:02:47 user nova-compute[75293]:   <domain>kvm</domain>
Nov 30 07:02:47 user nova-compute[75293]:   <machine>pc-q35-6.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:   <arch>i686</arch>
Nov 30 07:02:47 user nova-compute[75293]:   <vcpu max='288'/>
Nov 30 07:02:47 user nova-compute[75293]:   <iothreads supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:   <os supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:     <enum name='firmware'/>
Nov 30 07:02:47 user nova-compute[75293]:     <loader supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='type'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>rom</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>pflash</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='readonly'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>yes</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>no</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='secure'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>no</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </loader>
Nov 30 07:02:47 user nova-compute[75293]:   </os>
Nov 30 07:02:47 user nova-compute[75293]:   <cpu>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='host-passthrough' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='hostPassthroughMigratable'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>off</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='maximum' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='maximumMigratable'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>on</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>off</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='host-model' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <vendor>Intel</vendor>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ss'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='vmx'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='pcid'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='hypervisor'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='arat'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='umip'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='md-clear'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='stibp'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ssbd'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ibpb'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ibrs'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='amd-stibp'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='erms'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='lm'/>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='custom' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>qemu64</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>qemu32</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>phenom</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium3</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium2</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>n270</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>kvm64</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>kvm32</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>coreduo</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>core2duo</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>athlon</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Westmere</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Snowridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>SandyBridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Penryn</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G5</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G4</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G3</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G2</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G1</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Nehalem</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>IvyBridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Icelake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-Rome</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-Milan</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Dhyana</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cooperlake</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Conroe</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>486</model>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:   </cpu>
Nov 30 07:02:47 user nova-compute[75293]:   <memoryBacking supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:     <enum name='sourceType'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>file</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>anonymous</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>memfd</value>
Nov 30 07:02:47 user nova-compute[75293]:     </enum>
Nov 30 07:02:47 user nova-compute[75293]:   </memoryBacking>
Nov 30 07:02:47 user nova-compute[75293]:   <devices>
Nov 30 07:02:47 user nova-compute[75293]:     <disk supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='diskDevice'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>disk</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>cdrom</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>floppy</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>lun</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='bus'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>fdc</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>scsi</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>usb</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>sata</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-non-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </disk>
Nov 30 07:02:47 user nova-compute[75293]:     <graphics supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='type'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>sdl</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vnc</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>spice</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>egl-headless</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </graphics>
Nov 30 07:02:47 user nova-compute[75293]:     <video supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='modelType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vga</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>cirrus</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vmvga</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>qxl</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>none</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>bochs</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>ramfb</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </video>
Nov 30 07:02:47 user nova-compute[75293]:     <hostdev supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='mode'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>subsystem</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='startupPolicy'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>default</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>mandatory</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>requisite</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>optional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='subsysType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>usb</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>pci</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>scsi</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='capsType'/>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='pciBackend'/>
Nov 30 07:02:47 user nova-compute[75293]:     </hostdev>
Nov 30 07:02:47 user nova-compute[75293]:     <rng supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-non-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='backendModel'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>random</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>egd</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>builtin</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </rng>
Nov 30 07:02:47 user nova-compute[75293]:     <filesystem supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='driverType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>path</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>handle</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtiofs</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </filesystem>
Nov 30 07:02:47 user nova-compute[75293]:     <tpm supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>tpm-tis</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>tpm-crb</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='backendModel'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>passthrough</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>emulator</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </tpm>
Nov 30 07:02:47 user nova-compute[75293]:   </devices>
Nov 30 07:02:47 user nova-compute[75293]:   <features>
Nov 30 07:02:47 user nova-compute[75293]:     <gic supported='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     <vmcoreinfo supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <genid supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <backingStoreInput supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <backup supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <sev supported='no'/>
Nov 30 07:02:47 user nova-compute[75293]:   </features>
Nov 30 07:02:47 user nova-compute[75293]: </domainCapabilities>
Nov 30 07:02:47 user nova-compute[75293]:  {{(pid=75293) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 30 07:02:47 user nova-compute[75293]: <domainCapabilities>
Nov 30 07:02:47 user nova-compute[75293]:   <path>/usr/bin/qemu-system-i386</path>
Nov 30 07:02:47 user nova-compute[75293]:   <domain>kvm</domain>
Nov 30 07:02:47 user nova-compute[75293]:   <machine>pc-i440fx-jammy</machine>
Nov 30 07:02:47 user nova-compute[75293]:   <arch>i686</arch>
Nov 30 07:02:47 user nova-compute[75293]:   <vcpu max='255'/>
Nov 30 07:02:47 user nova-compute[75293]:   <iothreads supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:   <os supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:     <enum name='firmware'/>
Nov 30 07:02:47 user nova-compute[75293]:     <loader supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='type'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>rom</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>pflash</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='readonly'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>yes</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>no</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='secure'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>no</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </loader>
Nov 30 07:02:47 user nova-compute[75293]:   </os>
Nov 30 07:02:47 user nova-compute[75293]:   <cpu>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='host-passthrough' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='hostPassthroughMigratable'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>off</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='maximum' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='maximumMigratable'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>on</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>off</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='host-model' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <vendor>Intel</vendor>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ss'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='vmx'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='pcid'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='hypervisor'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='arat'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='umip'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='md-clear'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='stibp'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ssbd'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ibpb'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ibrs'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='amd-stibp'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='erms'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='lm'/>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='custom' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>qemu64</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>qemu32</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>phenom</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium3</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium2</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>n270</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>kvm64</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>kvm32</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>coreduo</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>core2duo</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>athlon</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Westmere-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Westmere</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Snowridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>SandyBridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Penryn</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G5</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G4</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G3</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G2</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G1</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Nehalem-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Nehalem</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>IvyBridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Icelake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-Rome</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-Milan</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Dhyana</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cooperlake</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Conroe</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>486</model>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:   </cpu>
Nov 30 07:02:47 user nova-compute[75293]:   <memoryBacking supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:     <enum name='sourceType'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>file</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>anonymous</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>memfd</value>
Nov 30 07:02:47 user nova-compute[75293]:     </enum>
Nov 30 07:02:47 user nova-compute[75293]:   </memoryBacking>
Nov 30 07:02:47 user nova-compute[75293]:   <devices>
Nov 30 07:02:47 user nova-compute[75293]:     <disk supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='diskDevice'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>disk</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>cdrom</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>floppy</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>lun</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='bus'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>ide</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>fdc</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>scsi</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>usb</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>sata</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-non-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </disk>
Nov 30 07:02:47 user nova-compute[75293]:     <graphics supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='type'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>sdl</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vnc</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>spice</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>egl-headless</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </graphics>
Nov 30 07:02:47 user nova-compute[75293]:     <video supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='modelType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vga</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>cirrus</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vmvga</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>qxl</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>none</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>bochs</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>ramfb</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </video>
Nov 30 07:02:47 user nova-compute[75293]:     <hostdev supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='mode'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>subsystem</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='startupPolicy'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>default</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>mandatory</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>requisite</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>optional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='subsysType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>usb</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>pci</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>scsi</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='capsType'/>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='pciBackend'/>
Nov 30 07:02:47 user nova-compute[75293]:     </hostdev>
Nov 30 07:02:47 user nova-compute[75293]:     <rng supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-non-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='backendModel'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>random</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>egd</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>builtin</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </rng>
Nov 30 07:02:47 user nova-compute[75293]:     <filesystem supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='driverType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>path</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>handle</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtiofs</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </filesystem>
Nov 30 07:02:47 user nova-compute[75293]:     <tpm supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>tpm-tis</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>tpm-crb</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='backendModel'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>passthrough</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>emulator</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </tpm>
Nov 30 07:02:47 user nova-compute[75293]:   </devices>
Nov 30 07:02:47 user nova-compute[75293]:   <features>
Nov 30 07:02:47 user nova-compute[75293]:     <gic supported='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     <vmcoreinfo supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <genid supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <backingStoreInput supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <backup supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <sev supported='no'/>
Nov 30 07:02:47 user nova-compute[75293]:   </features>
Nov 30 07:02:47 user nova-compute[75293]: </domainCapabilities>
Nov 30 07:02:47 user nova-compute[75293]:  {{(pid=75293) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 30 07:02:47 user nova-compute[75293]: <domainCapabilities>
Nov 30 07:02:47 user nova-compute[75293]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 07:02:47 user nova-compute[75293]:   <domain>kvm</domain>
Nov 30 07:02:47 user nova-compute[75293]:   <machine>pc-i440fx-6.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:   <arch>x86_64</arch>
Nov 30 07:02:47 user nova-compute[75293]:   <vcpu max='255'/>
Nov 30 07:02:47 user nova-compute[75293]:   <iothreads supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:   <os supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:     <enum name='firmware'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>efi</value>
Nov 30 07:02:47 user nova-compute[75293]:     </enum>
Nov 30 07:02:47 user nova-compute[75293]:     <loader supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='type'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>rom</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>pflash</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='readonly'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>yes</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>no</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='secure'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>no</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </loader>
Nov 30 07:02:47 user nova-compute[75293]:   </os>
Nov 30 07:02:47 user nova-compute[75293]:   <cpu>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='host-passthrough' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='hostPassthroughMigratable'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>on</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>off</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='maximum' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='maximumMigratable'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>on</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>off</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='host-model' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <vendor>Intel</vendor>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ss'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='vmx'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='pcid'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='hypervisor'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='arat'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='umip'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='md-clear'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='stibp'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ssbd'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='invtsc'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ibpb'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ibrs'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='amd-stibp'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='rsba'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='erms'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='custom' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>qemu64</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>qemu32</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>phenom</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium3</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium2</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>n270</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>kvm64</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>kvm32</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>coreduo</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>core2duo</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>athlon</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Westmere</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Snowridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>SandyBridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Penryn</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G5</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G4</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G3</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G2</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Opteron_G1</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Nehalem</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>IvyBridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Icelake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-Rome</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-Milan</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Dhyana</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cooperlake</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Conroe</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>486</model>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:   </cpu>
Nov 30 07:02:47 user nova-compute[75293]:   <memoryBacking supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:     <enum name='sourceType'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>file</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>anonymous</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>memfd</value>
Nov 30 07:02:47 user nova-compute[75293]:     </enum>
Nov 30 07:02:47 user nova-compute[75293]:   </memoryBacking>
Nov 30 07:02:47 user nova-compute[75293]:   <devices>
Nov 30 07:02:47 user nova-compute[75293]:     <disk supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='diskDevice'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>disk</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>cdrom</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>floppy</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>lun</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='bus'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>ide</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>fdc</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>scsi</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>usb</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>sata</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-non-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </disk>
Nov 30 07:02:47 user nova-compute[75293]:     <graphics supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='type'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>sdl</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vnc</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>spice</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>egl-headless</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </graphics>
Nov 30 07:02:47 user nova-compute[75293]:     <video supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='modelType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vga</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>cirrus</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vmvga</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>qxl</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>none</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>bochs</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>ramfb</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </video>
Nov 30 07:02:47 user nova-compute[75293]:     <hostdev supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='mode'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>subsystem</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='startupPolicy'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>default</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>mandatory</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>requisite</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>optional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='subsysType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>usb</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>pci</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>scsi</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='capsType'/>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='pciBackend'/>
Nov 30 07:02:47 user nova-compute[75293]:     </hostdev>
Nov 30 07:02:47 user nova-compute[75293]:     <rng supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-non-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='backendModel'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>random</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>egd</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>builtin</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </rng>
Nov 30 07:02:47 user nova-compute[75293]:     <filesystem supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='driverType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>path</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>handle</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtiofs</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </filesystem>
Nov 30 07:02:47 user nova-compute[75293]:     <tpm supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>tpm-tis</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>tpm-crb</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='backendModel'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>passthrough</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>emulator</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </tpm>
Nov 30 07:02:47 user nova-compute[75293]:   </devices>
Nov 30 07:02:47 user nova-compute[75293]:   <features>
Nov 30 07:02:47 user nova-compute[75293]:     <gic supported='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     <vmcoreinfo supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <genid supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <backingStoreInput supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <backup supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <sev supported='no'/>
Nov 30 07:02:47 user nova-compute[75293]:   </features>
Nov 30 07:02:47 user nova-compute[75293]: </domainCapabilities>
Nov 30 07:02:47 user nova-compute[75293]:  {{(pid=75293) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 30 07:02:47 user nova-compute[75293]: <domainCapabilities>
Nov 30 07:02:47 user nova-compute[75293]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 07:02:47 user nova-compute[75293]:   <domain>kvm</domain>
Nov 30 07:02:47 user nova-compute[75293]:   <machine>pc-q35-jammy</machine>
Nov 30 07:02:47 user nova-compute[75293]:   <arch>x86_64</arch>
Nov 30 07:02:47 user nova-compute[75293]:   <vcpu max='288'/>
Nov 30 07:02:47 user nova-compute[75293]:   <iothreads supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:   <os supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:     <enum name='firmware'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>efi</value>
Nov 30 07:02:47 user nova-compute[75293]:     </enum>
Nov 30 07:02:47 user nova-compute[75293]:     <loader supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='type'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>rom</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>pflash</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='readonly'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>yes</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>no</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='secure'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>yes</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>no</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </loader>
Nov 30 07:02:47 user nova-compute[75293]:   </os>
Nov 30 07:02:47 user nova-compute[75293]:   <cpu>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='host-passthrough' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='hostPassthroughMigratable'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>on</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>off</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='maximum' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='maximumMigratable'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>on</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>off</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='host-model' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <vendor>Intel</vendor>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ss'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='vmx'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='pcid'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='hypervisor'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='arat'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='umip'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='md-clear'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='stibp'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ssbd'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='invtsc'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ibpb'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ibrs'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='amd-stibp'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='rsba'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='erms'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='custom' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>qemu64</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>qemu32</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>phenom</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium3</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium2</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>n270</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>kvm64</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>kvm32</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>coreduo</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>core2duo</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>athlon</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Westmere</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Snowridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>SandyBridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Penryn</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G5</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G4</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G3</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G2</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Opteron_G1</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Nehalem</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>IvyBridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Icelake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-Rome</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-Milan</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Dhyana</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cooperlake</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Conroe</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>486</model>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:   </cpu>
Nov 30 07:02:47 user nova-compute[75293]:   <memoryBacking supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:     <enum name='sourceType'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>file</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>anonymous</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>memfd</value>
Nov 30 07:02:47 user nova-compute[75293]:     </enum>
Nov 30 07:02:47 user nova-compute[75293]:   </memoryBacking>
Nov 30 07:02:47 user nova-compute[75293]:   <devices>
Nov 30 07:02:47 user nova-compute[75293]:     <disk supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='diskDevice'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>disk</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>cdrom</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>floppy</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>lun</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='bus'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>fdc</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>scsi</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>usb</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>sata</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-non-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </disk>
Nov 30 07:02:47 user nova-compute[75293]:     <graphics supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='type'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>sdl</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vnc</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>spice</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>egl-headless</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </graphics>
Nov 30 07:02:47 user nova-compute[75293]:     <video supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='modelType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vga</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>cirrus</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vmvga</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>qxl</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>none</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>bochs</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>ramfb</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </video>
Nov 30 07:02:47 user nova-compute[75293]:     <hostdev supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='mode'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>subsystem</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='startupPolicy'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>default</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>mandatory</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>requisite</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>optional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='subsysType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>usb</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>pci</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>scsi</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='capsType'/>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='pciBackend'/>
Nov 30 07:02:47 user nova-compute[75293]:     </hostdev>
Nov 30 07:02:47 user nova-compute[75293]:     <rng supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-non-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='backendModel'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>random</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>egd</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>builtin</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </rng>
Nov 30 07:02:47 user nova-compute[75293]:     <filesystem supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='driverType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>path</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>handle</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtiofs</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </filesystem>
Nov 30 07:02:47 user nova-compute[75293]:     <tpm supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>tpm-tis</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>tpm-crb</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='backendModel'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>passthrough</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>emulator</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </tpm>
Nov 30 07:02:47 user nova-compute[75293]:   </devices>
Nov 30 07:02:47 user nova-compute[75293]:   <features>
Nov 30 07:02:47 user nova-compute[75293]:     <gic supported='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     <vmcoreinfo supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <genid supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <backingStoreInput supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <backup supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <sev supported='no'/>
Nov 30 07:02:47 user nova-compute[75293]:   </features>
Nov 30 07:02:47 user nova-compute[75293]: </domainCapabilities>
Nov 30 07:02:47 user nova-compute[75293]:  {{(pid=75293) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 30 07:02:47 user nova-compute[75293]: <domainCapabilities>
Nov 30 07:02:47 user nova-compute[75293]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 07:02:47 user nova-compute[75293]:   <domain>kvm</domain>
Nov 30 07:02:47 user nova-compute[75293]:   <machine>pc-q35-6.2</machine>
Nov 30 07:02:47 user nova-compute[75293]:   <arch>x86_64</arch>
Nov 30 07:02:47 user nova-compute[75293]:   <vcpu max='288'/>
Nov 30 07:02:47 user nova-compute[75293]:   <iothreads supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:   <os supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:     <enum name='firmware'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>efi</value>
Nov 30 07:02:47 user nova-compute[75293]:     </enum>
Nov 30 07:02:47 user nova-compute[75293]:     <loader supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='type'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>rom</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>pflash</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='readonly'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>yes</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>no</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='secure'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>yes</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>no</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </loader>
Nov 30 07:02:47 user nova-compute[75293]:   </os>
Nov 30 07:02:47 user nova-compute[75293]:   <cpu>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='host-passthrough' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='hostPassthroughMigratable'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>on</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>off</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='maximum' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='maximumMigratable'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>on</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>off</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='host-model' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <vendor>Intel</vendor>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ss'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='vmx'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='pcid'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='hypervisor'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='arat'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='umip'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='md-clear'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='stibp'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ssbd'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='invtsc'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ibpb'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ibrs'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='amd-stibp'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='rsba'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='erms'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='custom' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>qemu64</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>qemu32</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>phenom</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium3</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium2</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>n270</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>kvm64</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>kvm32</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>coreduo</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>core2duo</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>athlon</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Westmere</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Snowridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>SandyBridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Penryn</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G5</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G4</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G3</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G2</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Opteron_G1</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Nehalem</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>IvyBridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Icelake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-Rome</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-Milan</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Dhyana</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cooperlake</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Conroe</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>486</model>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:   </cpu>
Nov 30 07:02:47 user nova-compute[75293]:   <memoryBacking supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:     <enum name='sourceType'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>file</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>anonymous</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>memfd</value>
Nov 30 07:02:47 user nova-compute[75293]:     </enum>
Nov 30 07:02:47 user nova-compute[75293]:   </memoryBacking>
Nov 30 07:02:47 user nova-compute[75293]:   <devices>
Nov 30 07:02:47 user nova-compute[75293]:     <disk supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='diskDevice'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>disk</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>cdrom</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>floppy</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>lun</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='bus'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>fdc</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>scsi</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>usb</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>sata</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-non-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </disk>
Nov 30 07:02:47 user nova-compute[75293]:     <graphics supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='type'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>sdl</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vnc</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>spice</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>egl-headless</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </graphics>
Nov 30 07:02:47 user nova-compute[75293]:     <video supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='modelType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vga</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>cirrus</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vmvga</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>qxl</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>none</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>bochs</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>ramfb</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </video>
Nov 30 07:02:47 user nova-compute[75293]:     <hostdev supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='mode'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>subsystem</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='startupPolicy'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>default</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>mandatory</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>requisite</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>optional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='subsysType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>usb</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>pci</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>scsi</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='capsType'/>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='pciBackend'/>
Nov 30 07:02:47 user nova-compute[75293]:     </hostdev>
Nov 30 07:02:47 user nova-compute[75293]:     <rng supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-non-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='backendModel'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>random</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>egd</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>builtin</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </rng>
Nov 30 07:02:47 user nova-compute[75293]:     <filesystem supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='driverType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>path</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>handle</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtiofs</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </filesystem>
Nov 30 07:02:47 user nova-compute[75293]:     <tpm supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>tpm-tis</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>tpm-crb</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='backendModel'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>passthrough</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>emulator</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </tpm>
Nov 30 07:02:47 user nova-compute[75293]:   </devices>
Nov 30 07:02:47 user nova-compute[75293]:   <features>
Nov 30 07:02:47 user nova-compute[75293]:     <gic supported='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     <vmcoreinfo supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <genid supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <backingStoreInput supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <backup supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <sev supported='no'/>
Nov 30 07:02:47 user nova-compute[75293]:   </features>
Nov 30 07:02:47 user nova-compute[75293]: </domainCapabilities>
Nov 30 07:02:47 user nova-compute[75293]:  {{(pid=75293) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 30 07:02:47 user nova-compute[75293]: <domainCapabilities>
Nov 30 07:02:47 user nova-compute[75293]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 30 07:02:47 user nova-compute[75293]:   <domain>kvm</domain>
Nov 30 07:02:47 user nova-compute[75293]:   <machine>pc-i440fx-jammy</machine>
Nov 30 07:02:47 user nova-compute[75293]:   <arch>x86_64</arch>
Nov 30 07:02:47 user nova-compute[75293]:   <vcpu max='255'/>
Nov 30 07:02:47 user nova-compute[75293]:   <iothreads supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:   <os supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:     <enum name='firmware'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>efi</value>
Nov 30 07:02:47 user nova-compute[75293]:     </enum>
Nov 30 07:02:47 user nova-compute[75293]:     <loader supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='type'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>rom</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>pflash</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='readonly'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>yes</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>no</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='secure'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>no</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </loader>
Nov 30 07:02:47 user nova-compute[75293]:   </os>
Nov 30 07:02:47 user nova-compute[75293]:   <cpu>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='host-passthrough' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='hostPassthroughMigratable'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>on</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>off</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='maximum' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='maximumMigratable'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>on</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>off</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='host-model' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <vendor>Intel</vendor>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ss'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='vmx'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='pcid'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='hypervisor'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='arat'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='tsc_adjust'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='umip'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='md-clear'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='stibp'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='arch-capabilities'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ssbd'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='invtsc'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ibpb'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='ibrs'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='amd-stibp'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='amd-ssbd'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='rsba'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='require' name='pschange-mc-no'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='erms'/>
Nov 30 07:02:47 user nova-compute[75293]:       <feature policy='disable' name='xsaveopt'/>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:     <mode name='custom' supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>qemu64</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>qemu32</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>phenom</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium3</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium2</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>pentium</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>n270</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>kvm64</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>kvm32</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>coreduo</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>core2duo</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>athlon</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Westmere-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Westmere</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Snowridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Skylake-Client</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>SandyBridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Penryn</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G5</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G4</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G3</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Opteron_G2</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Opteron_G1</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Nehalem</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>IvyBridge</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Icelake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Haswell</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-Rome</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-Milan</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC-IBPB</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>EPYC</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Dhyana</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cooperlake</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>Conroe</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Cascadelake-Server</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-noTSX</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell-IBRS</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='no'>Broadwell</model>
Nov 30 07:02:47 user nova-compute[75293]:       <model usable='yes'>486</model>
Nov 30 07:02:47 user nova-compute[75293]:     </mode>
Nov 30 07:02:47 user nova-compute[75293]:   </cpu>
Nov 30 07:02:47 user nova-compute[75293]:   <memoryBacking supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:     <enum name='sourceType'>
Nov 30 07:02:47 user nova-compute[75293]:       <value>file</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>anonymous</value>
Nov 30 07:02:47 user nova-compute[75293]:       <value>memfd</value>
Nov 30 07:02:47 user nova-compute[75293]:     </enum>
Nov 30 07:02:47 user nova-compute[75293]:   </memoryBacking>
Nov 30 07:02:47 user nova-compute[75293]:   <devices>
Nov 30 07:02:47 user nova-compute[75293]:     <disk supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='diskDevice'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>disk</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>cdrom</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>floppy</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>lun</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='bus'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>ide</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>fdc</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>scsi</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>usb</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>sata</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-non-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </disk>
Nov 30 07:02:47 user nova-compute[75293]:     <graphics supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='type'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>sdl</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vnc</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>spice</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>egl-headless</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </graphics>
Nov 30 07:02:47 user nova-compute[75293]:     <video supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='modelType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vga</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>cirrus</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>vmvga</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>qxl</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>none</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>bochs</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>ramfb</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </video>
Nov 30 07:02:47 user nova-compute[75293]:     <hostdev supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='mode'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>subsystem</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='startupPolicy'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>default</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>mandatory</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>requisite</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>optional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='subsysType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>usb</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>pci</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>scsi</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='capsType'/>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='pciBackend'/>
Nov 30 07:02:47 user nova-compute[75293]:     </hostdev>
Nov 30 07:02:47 user nova-compute[75293]:     <rng supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtio-non-transitional</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='backendModel'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>random</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>egd</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>builtin</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </rng>
Nov 30 07:02:47 user nova-compute[75293]:     <filesystem supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='driverType'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>path</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>handle</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>virtiofs</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </filesystem>
Nov 30 07:02:47 user nova-compute[75293]:     <tpm supported='yes'>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='model'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>tpm-tis</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>tpm-crb</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:       <enum name='backendModel'>
Nov 30 07:02:47 user nova-compute[75293]:         <value>passthrough</value>
Nov 30 07:02:47 user nova-compute[75293]:         <value>emulator</value>
Nov 30 07:02:47 user nova-compute[75293]:       </enum>
Nov 30 07:02:47 user nova-compute[75293]:     </tpm>
Nov 30 07:02:47 user nova-compute[75293]:   </devices>
Nov 30 07:02:47 user nova-compute[75293]:   <features>
Nov 30 07:02:47 user nova-compute[75293]:     <gic supported='no'/>
Nov 30 07:02:47 user nova-compute[75293]:     <vmcoreinfo supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <genid supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <backingStoreInput supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <backup supported='yes'/>
Nov 30 07:02:47 user nova-compute[75293]:     <sev supported='no'/>
Nov 30 07:02:47 user nova-compute[75293]:   </features>
Nov 30 07:02:47 user nova-compute[75293]: </domainCapabilities>
Nov 30 07:02:47 user nova-compute[75293]:  {{(pid=75293) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75293) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75293) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Checking secure boot support for host arch (x86_64) {{(pid=75293) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Checking secure boot support for host arch (x86_64) {{(pid=75293) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Checking secure boot support for host arch (x86_64) {{(pid=75293) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 30 07:02:47 user nova-compute[75293]: INFO nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Secure Boot support detected
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] cpu compare xml: <cpu match="exact">
Nov 30 07:02:47 user nova-compute[75293]:   <model>Nehalem</model>
Nov 30 07:02:47 user nova-compute[75293]: </cpu>
Nov 30 07:02:47 user nova-compute[75293]:  {{(pid=75293) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 30 07:02:47 user nova-compute[75293]: INFO nova.virt.node [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Generated node identity 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa
Nov 30 07:02:47 user nova-compute[75293]: INFO nova.virt.node [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Wrote node identity 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa to /opt/stack/data/nova/compute_id
Nov 30 07:02:47 user nova-compute[75293]: WARNING nova.compute.manager [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Compute nodes ['82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 30 07:02:47 user nova-compute[75293]: INFO nova.compute.manager [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 30 07:02:47 user nova-compute[75293]: WARNING nova.compute.manager [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 30 07:02:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:02:47 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:02:48 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:02:48 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:02:48 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Hypervisor/Node resource view: name=user free_ram=10946MB free_disk=26.18268585205078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:02:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:02:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:02:48 user nova-compute[75293]: WARNING nova.compute.resource_tracker [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] No compute node record for user:82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa could not be found.
Nov 30 07:02:48 user nova-compute[75293]: INFO nova.compute.resource_tracker [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Compute node record created for user:user with uuid: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa
Nov 30 07:02:48 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:02:48 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:02:48 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] [req-afede069-40fa-4ae1-9f70-d60df4fa1562] Created resource provider record via placement API for resource provider with UUID 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa and name user.
Nov 30 07:02:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75293) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 30 07:02:48 user nova-compute[75293]: INFO nova.virt.libvirt.host [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] kernel doesn't support AMD SEV
Nov 30 07:02:48 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Updating inventory in ProviderTree for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 07:02:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:02:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Libvirt baseline CPU <cpu>
Nov 30 07:02:48 user nova-compute[75293]:   <arch>x86_64</arch>
Nov 30 07:02:48 user nova-compute[75293]:   <model>Nehalem</model>
Nov 30 07:02:48 user nova-compute[75293]:   <vendor>Intel</vendor>
Nov 30 07:02:48 user nova-compute[75293]:   <topology sockets="6" cores="1" threads="1"/>
Nov 30 07:02:48 user nova-compute[75293]: </cpu>
Nov 30 07:02:48 user nova-compute[75293]:  {{(pid=75293) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 30 07:02:48 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Updated inventory for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 30 07:02:48 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Updating resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa generation from 0 to 1 during operation: update_inventory {{(pid=75293) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 30 07:02:48 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Updating inventory in ProviderTree for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 07:02:48 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Updating resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa generation from 1 to 2 during operation: update_traits {{(pid=75293) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 30 07:02:48 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:02:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.685s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:02:48 user nova-compute[75293]: DEBUG nova.service [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Creating RPC server for service compute {{(pid=75293) start /opt/stack/nova/nova/service.py:182}}
Nov 30 07:02:48 user nova-compute[75293]: DEBUG nova.service [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] Join ServiceGroup membership for this service compute {{(pid=75293) start /opt/stack/nova/nova/service.py:199}}
Nov 30 07:02:48 user nova-compute[75293]: DEBUG nova.servicegroup.drivers.db [None req-ec9befa6-1f56-4ad9-ad0d-bbdd1b0a8612 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75293) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 30 07:03:17 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._sync_power_states {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:03:17 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:03:39 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:03:39 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:03:39 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:03:39 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Rebuilding the list of instances to heal {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 07:03:39 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Didn't find any instances for network info cache update. {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 07:03:39 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:03:39 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:03:39 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:03:39 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:03:39 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:03:39 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:03:39 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:03:39 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:03:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:03:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:03:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:03:39 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:03:40 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:03:40 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:03:40 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=10366MB free_disk=26.086441040039062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:03:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:03:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:03:40 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:03:40 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:03:40 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:03:40 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:03:40 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:03:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:04:40 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:04:40 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:04:40 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:04:40 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:04:40 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:04:40 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Rebuilding the list of instances to heal {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 07:04:40 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Didn't find any instances for network info cache update. {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 07:04:40 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:04:40 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:04:40 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:04:40 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:04:40 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:04:41 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:04:41 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:04:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:04:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:04:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:04:41 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:04:42 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:04:42 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:04:42 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=10304MB free_disk=26.150768280029297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:04:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:04:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:04:42 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:04:42 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:04:42 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:04:42 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:04:42 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:04:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:05:40 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:05:40 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:05:40 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:05:40 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:05:40 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:05:41 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:05:42 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:05:42 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:05:42 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Rebuilding the list of instances to heal {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 07:05:42 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Didn't find any instances for network info cache update. {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 07:05:42 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:05:42 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:05:43 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:05:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:05:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:05:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:05:43 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:05:44 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:05:44 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:05:44 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=10305MB free_disk=25.90313720703125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:05:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:05:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:05:44 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:05:44 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:05:44 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:05:44 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:05:44 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:05:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:06:41 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:06:41 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:06:41 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:06:41 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:06:42 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:06:42 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:06:43 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:06:43 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:06:43 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:06:44 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:06:44 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:06:44 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Rebuilding the list of instances to heal {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 07:06:44 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Didn't find any instances for network info cache update. {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 07:06:44 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:06:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:06:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:06:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:06:44 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:06:45 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:06:45 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:06:45 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=9620MB free_disk=25.923194885253906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:06:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:06:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:06:45 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:06:45 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:06:45 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:06:45 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:06:45 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:06:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:06:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:06:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:06:58 user nova-compute[75293]: DEBUG nova.compute.manager [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:06:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:06:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:06:58 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:06:58 user nova-compute[75293]: INFO nova.compute.claims [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Claim successful on node user
Nov 30 07:06:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "1b7deb0a-39af-4d93-b93d-5765a731f702" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:06:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "1b7deb0a-39af-4d93-b93d-5765a731f702" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:06:58 user nova-compute[75293]: DEBUG nova.compute.manager [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:06:58 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:06:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:06:58 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:06:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:06:58 user nova-compute[75293]: DEBUG nova.compute.manager [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:06:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.073s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:06:58 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:06:58 user nova-compute[75293]: INFO nova.compute.claims [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Claim successful on node user
Nov 30 07:06:59 user nova-compute[75293]: DEBUG nova.compute.manager [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:06:59 user nova-compute[75293]: DEBUG nova.network.neutron [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:06:59 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:06:59 user nova-compute[75293]: DEBUG nova.compute.manager [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:06:59 user nova-compute[75293]: DEBUG nova.compute.manager [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:06:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:06:59 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Creating image(s)
Nov 30 07:06:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:06:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "/opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:06:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "/opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:06:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:06:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:06:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "251604ac-b300-49ae-ae1a-4543665fead6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:06:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "251604ac-b300-49ae-ae1a-4543665fead6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:06:59 user nova-compute[75293]: DEBUG nova.compute.manager [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:06:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:06:59 user nova-compute[75293]: DEBUG nova.policy [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8dfa6fb751d6425f93feabaa8402cd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19ade0f478e4fa09780686118f9155c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:06:59 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:06:59 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:06:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.639s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:06:59 user nova-compute[75293]: DEBUG nova.compute.manager [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:06:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.188s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:06:59 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:06:59 user nova-compute[75293]: INFO nova.compute.claims [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Claim successful on node user
Nov 30 07:06:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1.part --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG nova.compute.manager [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG nova.network.neutron [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:07:00 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:07:00 user nova-compute[75293]: DEBUG nova.compute.manager [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1.part --force-share --output=json" returned: 0 in 0.171s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG nova.virt.images [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] 0546aff3-0862-4c77-a7b6-1bcd52baadc2 was qcow2, converting to raw {{(pid=75293) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG nova.privsep.utils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75293) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1.part /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1.converted {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.702s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG nova.compute.manager [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1.part /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1.converted" returned: 0 in 0.175s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1.converted --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG nova.compute.manager [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:07:00 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Creating image(s)
Nov 30 07:07:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "/opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "/opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG nova.compute.manager [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG nova.network.neutron [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:07:00 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:07:00 user nova-compute[75293]: DEBUG nova.compute.manager [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG nova.policy [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '917adc7b254e4711ad5f5adbdd2689d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d94d0308eb444dbdcd3e5c7c21fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.296s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:00 user nova-compute[75293]: INFO oslo.privsep.daemon [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkasyh0ga/privsep.sock']
Nov 30 07:07:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.156s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:00 user sudo[84550]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkasyh0ga/privsep.sock
Nov 30 07:07:00 user sudo[84550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 30 07:07:00 user nova-compute[75293]: DEBUG nova.compute.manager [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:07:00 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Creating image(s)
Nov 30 07:07:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "/opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "/opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "/opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:00 user nova-compute[75293]: DEBUG nova.policy [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e385a89f913645dd9fd2770e6e7445da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aa2f5bea3d44ecb10ff083d6f76038', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:07:01 user nova-compute[75293]: DEBUG nova.network.neutron [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Successfully created port: 59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:07:02 user sudo[84550]: pam_unix(sudo:session): session closed for user root
Nov 30 07:07:02 user nova-compute[75293]: INFO oslo.privsep.daemon [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Spawned new privsep daemon via rootwrap
Nov 30 07:07:02 user nova-compute[75293]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 30 07:07:02 user nova-compute[75293]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 30 07:07:02 user nova-compute[75293]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 30 07:07:02 user nova-compute[75293]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84557
Nov 30 07:07:02 user nova-compute[75293]: WARNING oslo_privsep.priv_context [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] privsep daemon already running
Nov 30 07:07:02 user nova-compute[75293]: WARNING oslo_privsep.priv_context [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] privsep daemon already running
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.174s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.174s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.168s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.165s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk 1073741824" returned: 0 in 0.039s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.209s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.162s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.194s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk 1073741824" returned: 0 in 0.049s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.472s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Cannot resize image /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Ensure instance console log exists: /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.175s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG nova.network.neutron [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Successfully created port: 26f5514b-9205-4e17-9d2b-2196aaa085d2 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.190s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk 1073741824" returned: 0 in 0.048s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG nova.network.neutron [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Successfully created port: 7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Cannot resize image /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Ensure instance console log exists: /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.174s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Checking if we can resize image /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Cannot resize image /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Ensure instance console log exists: /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG nova.network.neutron [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Successfully updated port: 59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquired lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:07:03 user nova-compute[75293]: DEBUG nova.network.neutron [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:07:04 user nova-compute[75293]: DEBUG nova.network.neutron [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:07:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-9fa480bf-504b-4a43-a3e9-41467e43de6b req-d63b851c-2c14-438d-b056-07ae34863341 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-changed-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-9fa480bf-504b-4a43-a3e9-41467e43de6b req-d63b851c-2c14-438d-b056-07ae34863341 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Refreshing instance network info cache due to event network-changed-59532faa-7c54-4c8f-ac5f-bea10353a48d. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:07:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9fa480bf-504b-4a43-a3e9-41467e43de6b req-d63b851c-2c14-438d-b056-07ae34863341 service nova] Acquiring lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.network.neutron [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Updating instance_info_cache with network_info: [{"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Releasing lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.compute.manager [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Instance network_info: |[{"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9fa480bf-504b-4a43-a3e9-41467e43de6b req-d63b851c-2c14-438d-b056-07ae34863341 service nova] Acquired lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.network.neutron [req-9fa480bf-504b-4a43-a3e9-41467e43de6b req-d63b851c-2c14-438d-b056-07ae34863341 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Refreshing network info cache for port 59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Start _get_guest_xml network_info=[{"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:07:05 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:05 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.privsep.utils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75293) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1726376547',display_name='tempest-ServerStableDeviceRescueTest-server-1726376547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1726376547',id=1,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2zqZqO0QK157+eSrLkJyxdVIfoBSFfpmYkPAeb8ikJKX0k4XMkh5q0M3TM7YT5CDeOyMhl/SU18f6cdJzqIgDsuiIfH9NGqE4O4Mw8kvIb2EixuK2eyb5uN/WJbVm++Q==',key_name='tempest-keypair-1570503927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d19ade0f478e4fa09780686118f9155c',ramdisk_id='',reservation_id='r-l5vpvaom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-786185367',owner_user_name='tempest-ServerStableDeviceRescueTest-786185367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:06:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dfa6fb751d6425f93feabaa8402cd81',uuid=1b6dee8d-d419-47a3-b2be-4d15e17d6061,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Converting VIF {"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=59532faa-7c54-4c8f-ac5f-bea10353a48d,network=Network(e405aa5a-b440-40a0-bec7-796676ed00a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59532faa-7c') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.objects.instance [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b6dee8d-d419-47a3-b2be-4d15e17d6061 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.network.neutron [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Successfully updated port: 26f5514b-9205-4e17-9d2b-2196aaa085d2 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:07:05 user nova-compute[75293]:   <uuid>1b6dee8d-d419-47a3-b2be-4d15e17d6061</uuid>
Nov 30 07:07:05 user nova-compute[75293]:   <name>instance-00000001</name>
Nov 30 07:07:05 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:07:05 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:07:05 user nova-compute[75293]:   <metadata>
Nov 30 07:07:05 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:07:05 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:07:05 user nova-compute[75293]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1726376547</nova:name>
Nov 30 07:07:05 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:07:05</nova:creationTime>
Nov 30 07:07:05 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:07:05 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:07:05 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:07:05 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:07:05 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:07:05 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:07:05 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:07:05 user nova-compute[75293]:       <nova:owner>
Nov 30 07:07:05 user nova-compute[75293]:         <nova:user uuid="8dfa6fb751d6425f93feabaa8402cd81">tempest-ServerStableDeviceRescueTest-786185367-project-member</nova:user>
Nov 30 07:07:05 user nova-compute[75293]:         <nova:project uuid="d19ade0f478e4fa09780686118f9155c">tempest-ServerStableDeviceRescueTest-786185367</nova:project>
Nov 30 07:07:05 user nova-compute[75293]:       </nova:owner>
Nov 30 07:07:05 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:07:05 user nova-compute[75293]:       <nova:ports>
Nov 30 07:07:05 user nova-compute[75293]:         <nova:port uuid="59532faa-7c54-4c8f-ac5f-bea10353a48d">
Nov 30 07:07:05 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 07:07:05 user nova-compute[75293]:         </nova:port>
Nov 30 07:07:05 user nova-compute[75293]:       </nova:ports>
Nov 30 07:07:05 user nova-compute[75293]:     </nova:instance>
Nov 30 07:07:05 user nova-compute[75293]:   </metadata>
Nov 30 07:07:05 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:07:05 user nova-compute[75293]:     <system>
Nov 30 07:07:05 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:07:05 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:07:05 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:07:05 user nova-compute[75293]:       <entry name="serial">1b6dee8d-d419-47a3-b2be-4d15e17d6061</entry>
Nov 30 07:07:05 user nova-compute[75293]:       <entry name="uuid">1b6dee8d-d419-47a3-b2be-4d15e17d6061</entry>
Nov 30 07:07:05 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:07:05 user nova-compute[75293]:     </system>
Nov 30 07:07:05 user nova-compute[75293]:   </sysinfo>
Nov 30 07:07:05 user nova-compute[75293]:   <os>
Nov 30 07:07:05 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:07:05 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:07:05 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:07:05 user nova-compute[75293]:   </os>
Nov 30 07:07:05 user nova-compute[75293]:   <features>
Nov 30 07:07:05 user nova-compute[75293]:     <acpi/>
Nov 30 07:07:05 user nova-compute[75293]:     <apic/>
Nov 30 07:07:05 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:07:05 user nova-compute[75293]:   </features>
Nov 30 07:07:05 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:07:05 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:07:05 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:07:05 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:07:05 user nova-compute[75293]:   </clock>
Nov 30 07:07:05 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:07:05 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:07:05 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:07:05 user nova-compute[75293]:   </cpu>
Nov 30 07:07:05 user nova-compute[75293]:   <devices>
Nov 30 07:07:05 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:07:05 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:07:05 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk"/>
Nov 30 07:07:05 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:07:05 user nova-compute[75293]:     </disk>
Nov 30 07:07:05 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:07:05 user nova-compute[75293]:       <mac address="fa:16:3e:c6:2c:81"/>
Nov 30 07:07:05 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:07:05 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:07:05 user nova-compute[75293]:       <target dev="tap59532faa-7c"/>
Nov 30 07:07:05 user nova-compute[75293]:     </interface>
Nov 30 07:07:05 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:07:05 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/console.log" append="off"/>
Nov 30 07:07:05 user nova-compute[75293]:     </serial>
Nov 30 07:07:05 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:07:05 user nova-compute[75293]:     <video>
Nov 30 07:07:05 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:07:05 user nova-compute[75293]:     </video>
Nov 30 07:07:05 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:07:05 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:07:05 user nova-compute[75293]:     </rng>
Nov 30 07:07:05 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:07:05 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:07:05 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:07:05 user nova-compute[75293]:     </memballoon>
Nov 30 07:07:05 user nova-compute[75293]:   </devices>
Nov 30 07:07:05 user nova-compute[75293]: </domain>
Nov 30 07:07:05 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1726376547',display_name='tempest-ServerStableDeviceRescueTest-server-1726376547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1726376547',id=1,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2zqZqO0QK157+eSrLkJyxdVIfoBSFfpmYkPAeb8ikJKX0k4XMkh5q0M3TM7YT5CDeOyMhl/SU18f6cdJzqIgDsuiIfH9NGqE4O4Mw8kvIb2EixuK2eyb5uN/WJbVm++Q==',key_name='tempest-keypair-1570503927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d19ade0f478e4fa09780686118f9155c',ramdisk_id='',reservation_id='r-l5vpvaom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-786185367',owner_user_name='tempest-ServerStableDeviceRescueTest-786185367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:06:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dfa6fb751d6425f93feabaa8402cd81',uuid=1b6dee8d-d419-47a3-b2be-4d15e17d6061,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Converting VIF {"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=59532faa-7c54-4c8f-ac5f-bea10353a48d,network=Network(e405aa5a-b440-40a0-bec7-796676ed00a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59532faa-7c') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG os_vif [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=59532faa-7c54-4c8f-ac5f-bea10353a48d,network=Network(e405aa5a-b440-40a0-bec7-796676ed00a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59532faa-7c') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "refresh_cache-1b7deb0a-39af-4d93-b93d-5765a731f702" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquired lock "refresh_cache-1b7deb0a-39af-4d93-b93d-5765a731f702" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.network.neutron [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Created schema index Interface.name {{(pid=75293) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Created schema index Port.name {{(pid=75293) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Created schema index Bridge.name {{(pid=75293) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.network.neutron [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Successfully updated port: 7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [POLLOUT] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquired lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.network.neutron [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '917266f2-dc3a-54ea-b110-eb06118554e8', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:07:05 user nova-compute[75293]: INFO oslo.privsep.daemon [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp03gbvswv/privsep.sock']
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.compute.manager [req-f0c23d60-e7ab-442e-89b4-bc9a3ad15ec2 req-4582faea-a390-409d-b399-8a7b212f4beb service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Received event network-changed-26f5514b-9205-4e17-9d2b-2196aaa085d2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.compute.manager [req-f0c23d60-e7ab-442e-89b4-bc9a3ad15ec2 req-4582faea-a390-409d-b399-8a7b212f4beb service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Refreshing instance network info cache due to event network-changed-26f5514b-9205-4e17-9d2b-2196aaa085d2. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f0c23d60-e7ab-442e-89b4-bc9a3ad15ec2 req-4582faea-a390-409d-b399-8a7b212f4beb service nova] Acquiring lock "refresh_cache-1b7deb0a-39af-4d93-b93d-5765a731f702" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:07:05 user sudo[84606]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp03gbvswv/privsep.sock
Nov 30 07:07:05 user sudo[84606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.network.neutron [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG nova.network.neutron [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:07:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.network.neutron [req-9fa480bf-504b-4a43-a3e9-41467e43de6b req-d63b851c-2c14-438d-b056-07ae34863341 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Updated VIF entry in instance network info cache for port 59532faa-7c54-4c8f-ac5f-bea10353a48d. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.network.neutron [req-9fa480bf-504b-4a43-a3e9-41467e43de6b req-d63b851c-2c14-438d-b056-07ae34863341 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Updating instance_info_cache with network_info: [{"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9fa480bf-504b-4a43-a3e9-41467e43de6b req-d63b851c-2c14-438d-b056-07ae34863341 service nova] Releasing lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.network.neutron [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Updating instance_info_cache with network_info: [{"id": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "address": "fa:16:3e:bb:63:ac", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f5514b-92", "ovs_interfaceid": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.network.neutron [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Updating instance_info_cache with network_info: [{"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Releasing lock "refresh_cache-1b7deb0a-39af-4d93-b93d-5765a731f702" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.compute.manager [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Instance network_info: |[{"id": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "address": "fa:16:3e:bb:63:ac", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f5514b-92", "ovs_interfaceid": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f0c23d60-e7ab-442e-89b4-bc9a3ad15ec2 req-4582faea-a390-409d-b399-8a7b212f4beb service nova] Acquired lock "refresh_cache-1b7deb0a-39af-4d93-b93d-5765a731f702" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.network.neutron [req-f0c23d60-e7ab-442e-89b4-bc9a3ad15ec2 req-4582faea-a390-409d-b399-8a7b212f4beb service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Refreshing network info cache for port 26f5514b-9205-4e17-9d2b-2196aaa085d2 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Start _get_guest_xml network_info=[{"id": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "address": "fa:16:3e:bb:63:ac", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f5514b-92", "ovs_interfaceid": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Releasing lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.compute.manager [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Instance network_info: |[{"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Start _get_guest_xml network_info=[{"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:07:06 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:06 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:06 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:06 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-783117087',display_name='tempest-ServerActionsTestOtherA-server-783117087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-783117087',id=2,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInXIkcLXsgicVrKBV1FJ4eUk9bqleLqUW+Rfq2hagWXh0lWDRkNj3X54YFexKmG2fABDJgaloeZ046QUW/gM3BPiB1qacS7UzihRugfjl4tEjpyq1iC1dsqauDTmCgB5Q==',key_name='tempest-keypair-417038146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7d94d0308eb444dbdcd3e5c7c21fe79',ramdisk_id='',reservation_id='r-68k12gsn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1263829597',owner_user_name='tempest-ServerActionsTestOtherA-1263829597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='917adc7b254e4711ad5f5adbdd2689d4',uuid=1b7deb0a-39af-4d93-b93d-5765a731f702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "address": "fa:16:3e:bb:63:ac", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f5514b-92", "ovs_interfaceid": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converting VIF {"id": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "address": "fa:16:3e:bb:63:ac", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f5514b-92", "ovs_interfaceid": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:63:ac,bridge_name='br-int',has_traffic_filtering=True,id=26f5514b-9205-4e17-9d2b-2196aaa085d2,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f5514b-92') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.objects.instance [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b7deb0a-39af-4d93-b93d-5765a731f702 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1720061760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1720061760',id=3,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmznsMjyME+bFayB3TzkgHrsSuO5TgKvjxqc/rUuOyL/QpV4coa/hjsQhBDMiu/ZZazrEo74EbBS+0CeSXDTbH3pDd0GHSp57yUHop6vH4ahe2AH3WPMcQ4QoMkQZr2Cw==',key_name='tempest-keypair-466117858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18aa2f5bea3d44ecb10ff083d6f76038',ramdisk_id='',reservation_id='r-8g0ngsgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-763079906',owner_user_name='tempest-AttachVolumeShelveTestJSON-763079906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e385a89f913645dd9fd2770e6e7445da',uuid=251604ac-b300-49ae-ae1a-4543665fead6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converting VIF {"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=7cf6968f-9b43-4e24-9ade-d296716616fe,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf6968f-9b') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.objects.instance [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'pci_devices' on Instance uuid 251604ac-b300-49ae-ae1a-4543665fead6 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:07:06 user nova-compute[75293]:   <uuid>1b7deb0a-39af-4d93-b93d-5765a731f702</uuid>
Nov 30 07:07:06 user nova-compute[75293]:   <name>instance-00000002</name>
Nov 30 07:07:06 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:07:06 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:07:06 user nova-compute[75293]:   <metadata>
Nov 30 07:07:06 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:07:06 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:07:06 user nova-compute[75293]:       <nova:name>tempest-ServerActionsTestOtherA-server-783117087</nova:name>
Nov 30 07:07:06 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:07:06</nova:creationTime>
Nov 30 07:07:06 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:07:06 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:07:06 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:07:06 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:07:06 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:07:06 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:07:06 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:07:06 user nova-compute[75293]:       <nova:owner>
Nov 30 07:07:06 user nova-compute[75293]:         <nova:user uuid="917adc7b254e4711ad5f5adbdd2689d4">tempest-ServerActionsTestOtherA-1263829597-project-member</nova:user>
Nov 30 07:07:06 user nova-compute[75293]:         <nova:project uuid="b7d94d0308eb444dbdcd3e5c7c21fe79">tempest-ServerActionsTestOtherA-1263829597</nova:project>
Nov 30 07:07:06 user nova-compute[75293]:       </nova:owner>
Nov 30 07:07:06 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:07:06 user nova-compute[75293]:       <nova:ports>
Nov 30 07:07:06 user nova-compute[75293]:         <nova:port uuid="26f5514b-9205-4e17-9d2b-2196aaa085d2">
Nov 30 07:07:06 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 07:07:06 user nova-compute[75293]:         </nova:port>
Nov 30 07:07:06 user nova-compute[75293]:       </nova:ports>
Nov 30 07:07:06 user nova-compute[75293]:     </nova:instance>
Nov 30 07:07:06 user nova-compute[75293]:   </metadata>
Nov 30 07:07:06 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:07:06 user nova-compute[75293]:     <system>
Nov 30 07:07:06 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:07:06 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:07:06 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:07:06 user nova-compute[75293]:       <entry name="serial">1b7deb0a-39af-4d93-b93d-5765a731f702</entry>
Nov 30 07:07:06 user nova-compute[75293]:       <entry name="uuid">1b7deb0a-39af-4d93-b93d-5765a731f702</entry>
Nov 30 07:07:06 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:07:06 user nova-compute[75293]:     </system>
Nov 30 07:07:06 user nova-compute[75293]:   </sysinfo>
Nov 30 07:07:06 user nova-compute[75293]:   <os>
Nov 30 07:07:06 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:07:06 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:07:06 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:07:06 user nova-compute[75293]:   </os>
Nov 30 07:07:06 user nova-compute[75293]:   <features>
Nov 30 07:07:06 user nova-compute[75293]:     <acpi/>
Nov 30 07:07:06 user nova-compute[75293]:     <apic/>
Nov 30 07:07:06 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:07:06 user nova-compute[75293]:   </features>
Nov 30 07:07:06 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:07:06 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:07:06 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:07:06 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:07:06 user nova-compute[75293]:   </clock>
Nov 30 07:07:06 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:07:06 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:07:06 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:07:06 user nova-compute[75293]:   </cpu>
Nov 30 07:07:06 user nova-compute[75293]:   <devices>
Nov 30 07:07:06 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:07:06 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:07:06 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk"/>
Nov 30 07:07:06 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:07:06 user nova-compute[75293]:     </disk>
Nov 30 07:07:06 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:07:06 user nova-compute[75293]:       <mac address="fa:16:3e:bb:63:ac"/>
Nov 30 07:07:06 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:07:06 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:07:06 user nova-compute[75293]:       <target dev="tap26f5514b-92"/>
Nov 30 07:07:06 user nova-compute[75293]:     </interface>
Nov 30 07:07:06 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:07:06 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/console.log" append="off"/>
Nov 30 07:07:06 user nova-compute[75293]:     </serial>
Nov 30 07:07:06 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:07:06 user nova-compute[75293]:     <video>
Nov 30 07:07:06 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:07:06 user nova-compute[75293]:     </video>
Nov 30 07:07:06 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:07:06 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:07:06 user nova-compute[75293]:     </rng>
Nov 30 07:07:06 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:07:06 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:07:06 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:07:06 user nova-compute[75293]:     </memballoon>
Nov 30 07:07:06 user nova-compute[75293]:   </devices>
Nov 30 07:07:06 user nova-compute[75293]: </domain>
Nov 30 07:07:06 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-783117087',display_name='tempest-ServerActionsTestOtherA-server-783117087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-783117087',id=2,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInXIkcLXsgicVrKBV1FJ4eUk9bqleLqUW+Rfq2hagWXh0lWDRkNj3X54YFexKmG2fABDJgaloeZ046QUW/gM3BPiB1qacS7UzihRugfjl4tEjpyq1iC1dsqauDTmCgB5Q==',key_name='tempest-keypair-417038146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7d94d0308eb444dbdcd3e5c7c21fe79',ramdisk_id='',reservation_id='r-68k12gsn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1263829597',owner_user_name='tempest-ServerActionsTestOtherA-1263829597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='917adc7b254e4711ad5f5adbdd2689d4',uuid=1b7deb0a-39af-4d93-b93d-5765a731f702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "address": "fa:16:3e:bb:63:ac", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f5514b-92", "ovs_interfaceid": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converting VIF {"id": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "address": "fa:16:3e:bb:63:ac", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f5514b-92", "ovs_interfaceid": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:63:ac,bridge_name='br-int',has_traffic_filtering=True,id=26f5514b-9205-4e17-9d2b-2196aaa085d2,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f5514b-92') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG os_vif [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:63:ac,bridge_name='br-int',has_traffic_filtering=True,id=26f5514b-9205-4e17-9d2b-2196aaa085d2,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f5514b-92') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73e6660d-12ca-5000-8788-352606af4145', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:07:06 user nova-compute[75293]:   <uuid>251604ac-b300-49ae-ae1a-4543665fead6</uuid>
Nov 30 07:07:06 user nova-compute[75293]:   <name>instance-00000003</name>
Nov 30 07:07:06 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:07:06 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:07:06 user nova-compute[75293]:   <metadata>
Nov 30 07:07:06 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:07:06 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:07:06 user nova-compute[75293]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1720061760</nova:name>
Nov 30 07:07:06 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:07:06</nova:creationTime>
Nov 30 07:07:06 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:07:06 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:07:06 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:07:06 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:07:06 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:07:06 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:07:06 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:07:06 user nova-compute[75293]:       <nova:owner>
Nov 30 07:07:06 user nova-compute[75293]:         <nova:user uuid="e385a89f913645dd9fd2770e6e7445da">tempest-AttachVolumeShelveTestJSON-763079906-project-member</nova:user>
Nov 30 07:07:06 user nova-compute[75293]:         <nova:project uuid="18aa2f5bea3d44ecb10ff083d6f76038">tempest-AttachVolumeShelveTestJSON-763079906</nova:project>
Nov 30 07:07:06 user nova-compute[75293]:       </nova:owner>
Nov 30 07:07:06 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:07:06 user nova-compute[75293]:       <nova:ports>
Nov 30 07:07:06 user nova-compute[75293]:         <nova:port uuid="7cf6968f-9b43-4e24-9ade-d296716616fe">
Nov 30 07:07:06 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 07:07:06 user nova-compute[75293]:         </nova:port>
Nov 30 07:07:06 user nova-compute[75293]:       </nova:ports>
Nov 30 07:07:06 user nova-compute[75293]:     </nova:instance>
Nov 30 07:07:06 user nova-compute[75293]:   </metadata>
Nov 30 07:07:06 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:07:06 user nova-compute[75293]:     <system>
Nov 30 07:07:06 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:07:06 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:07:06 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:07:06 user nova-compute[75293]:       <entry name="serial">251604ac-b300-49ae-ae1a-4543665fead6</entry>
Nov 30 07:07:06 user nova-compute[75293]:       <entry name="uuid">251604ac-b300-49ae-ae1a-4543665fead6</entry>
Nov 30 07:07:06 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:07:06 user nova-compute[75293]:     </system>
Nov 30 07:07:06 user nova-compute[75293]:   </sysinfo>
Nov 30 07:07:06 user nova-compute[75293]:   <os>
Nov 30 07:07:06 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:07:06 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:07:06 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:07:06 user nova-compute[75293]:   </os>
Nov 30 07:07:06 user nova-compute[75293]:   <features>
Nov 30 07:07:06 user nova-compute[75293]:     <acpi/>
Nov 30 07:07:06 user nova-compute[75293]:     <apic/>
Nov 30 07:07:06 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:07:06 user nova-compute[75293]:   </features>
Nov 30 07:07:06 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:07:06 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:07:06 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:07:06 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:07:06 user nova-compute[75293]:   </clock>
Nov 30 07:07:06 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:07:06 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:07:06 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:07:06 user nova-compute[75293]:   </cpu>
Nov 30 07:07:06 user nova-compute[75293]:   <devices>
Nov 30 07:07:06 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:07:06 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:07:06 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk"/>
Nov 30 07:07:06 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:07:06 user nova-compute[75293]:     </disk>
Nov 30 07:07:06 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:07:06 user nova-compute[75293]:       <mac address="fa:16:3e:1e:ec:42"/>
Nov 30 07:07:06 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:07:06 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:07:06 user nova-compute[75293]:       <target dev="tap7cf6968f-9b"/>
Nov 30 07:07:06 user nova-compute[75293]:     </interface>
Nov 30 07:07:06 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:07:06 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/console.log" append="off"/>
Nov 30 07:07:06 user nova-compute[75293]:     </serial>
Nov 30 07:07:06 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:07:06 user nova-compute[75293]:     <video>
Nov 30 07:07:06 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:07:06 user nova-compute[75293]:     </video>
Nov 30 07:07:06 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:07:06 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:07:06 user nova-compute[75293]:     </rng>
Nov 30 07:07:06 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:07:06 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:07:06 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:07:06 user nova-compute[75293]:     </memballoon>
Nov 30 07:07:06 user nova-compute[75293]:   </devices>
Nov 30 07:07:06 user nova-compute[75293]: </domain>
Nov 30 07:07:06 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1720061760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1720061760',id=3,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmznsMjyME+bFayB3TzkgHrsSuO5TgKvjxqc/rUuOyL/QpV4coa/hjsQhBDMiu/ZZazrEo74EbBS+0CeSXDTbH3pDd0GHSp57yUHop6vH4ahe2AH3WPMcQ4QoMkQZr2Cw==',key_name='tempest-keypair-466117858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18aa2f5bea3d44ecb10ff083d6f76038',ramdisk_id='',reservation_id='r-8g0ngsgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-763079906',owner_user_name='tempest-AttachVolumeShelveTestJSON-763079906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e385a89f913645dd9fd2770e6e7445da',uuid=251604ac-b300-49ae-ae1a-4543665fead6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converting VIF {"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=7cf6968f-9b43-4e24-9ade-d296716616fe,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf6968f-9b') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG os_vif [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=7cf6968f-9b43-4e24-9ade-d296716616fe,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf6968f-9b') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '506617f2-9c8c-548b-9624-7b6f50463c95', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:07:07 user sudo[84606]: pam_unix(sudo:session): session closed for user root
Nov 30 07:07:07 user nova-compute[75293]: INFO oslo.privsep.daemon [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Spawned new privsep daemon via rootwrap
Nov 30 07:07:07 user nova-compute[75293]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 30 07:07:07 user nova-compute[75293]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 30 07:07:07 user nova-compute[75293]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 30 07:07:07 user nova-compute[75293]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84609
Nov 30 07:07:07 user nova-compute[75293]: WARNING oslo_privsep.priv_context [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] privsep daemon already running
Nov 30 07:07:07 user nova-compute[75293]: WARNING oslo_privsep.priv_context [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] privsep daemon already running
Nov 30 07:07:07 user nova-compute[75293]: DEBUG nova.compute.manager [req-f24d93ae-b1e8-4417-af36-d95de05d78b0 req-b28ce824-fb65-4b67-b486-f165f7674ba8 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received event network-changed-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG nova.compute.manager [req-f24d93ae-b1e8-4417-af36-d95de05d78b0 req-b28ce824-fb65-4b67-b486-f165f7674ba8 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Refreshing instance network info cache due to event network-changed-7cf6968f-9b43-4e24-9ade-d296716616fe. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f24d93ae-b1e8-4417-af36-d95de05d78b0 req-b28ce824-fb65-4b67-b486-f165f7674ba8 service nova] Acquiring lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f24d93ae-b1e8-4417-af36-d95de05d78b0 req-b28ce824-fb65-4b67-b486-f165f7674ba8 service nova] Acquired lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG nova.network.neutron [req-f24d93ae-b1e8-4417-af36-d95de05d78b0 req-b28ce824-fb65-4b67-b486-f165f7674ba8 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Refreshing network info cache for port 7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cf6968f-9b, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cf6968f-9b, col_values=(('qos', UUID('1246f9e6-4516-4606-bf3f-62e847f43ed0')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cf6968f-9b, col_values=(('external_ids', {'iface-id': '7cf6968f-9b43-4e24-9ade-d296716616fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:ec:42', 'vm-uuid': '251604ac-b300-49ae-ae1a-4543665fead6'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG nova.network.neutron [req-f0c23d60-e7ab-442e-89b4-bc9a3ad15ec2 req-4582faea-a390-409d-b399-8a7b212f4beb service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Updated VIF entry in instance network info cache for port 26f5514b-9205-4e17-9d2b-2196aaa085d2. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG nova.network.neutron [req-f0c23d60-e7ab-442e-89b4-bc9a3ad15ec2 req-4582faea-a390-409d-b399-8a7b212f4beb service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Updating instance_info_cache with network_info: [{"id": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "address": "fa:16:3e:bb:63:ac", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f5514b-92", "ovs_interfaceid": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:07 user nova-compute[75293]: INFO os_vif [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=7cf6968f-9b43-4e24-9ade-d296716616fe,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf6968f-9b')
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26f5514b-92, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26f5514b-92, col_values=(('qos', UUID('0bc86a7a-4487-423c-bab5-62a0d7879673')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26f5514b-92, col_values=(('external_ids', {'iface-id': '26f5514b-9205-4e17-9d2b-2196aaa085d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:63:ac', 'vm-uuid': '1b7deb0a-39af-4d93-b93d-5765a731f702'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f0c23d60-e7ab-442e-89b4-bc9a3ad15ec2 req-4582faea-a390-409d-b399-8a7b212f4beb service nova] Releasing lock "refresh_cache-1b7deb0a-39af-4d93-b93d-5765a731f702" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:07 user nova-compute[75293]: INFO os_vif [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:63:ac,bridge_name='br-int',has_traffic_filtering=True,id=26f5514b-9205-4e17-9d2b-2196aaa085d2,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f5514b-92')
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59532faa-7c, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59532faa-7c, col_values=(('qos', UUID('f0f4ff07-8fc9-4523-a22b-43bf62f46d9c')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59532faa-7c, col_values=(('external_ids', {'iface-id': '59532faa-7c54-4c8f-ac5f-bea10353a48d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:2c:81', 'vm-uuid': '1b6dee8d-d419-47a3-b2be-4d15e17d6061'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] No VIF found with MAC fa:16:3e:1e:ec:42, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] No VIF found with MAC fa:16:3e:bb:63:ac, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:07 user nova-compute[75293]: INFO os_vif [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=59532faa-7c54-4c8f-ac5f-bea10353a48d,network=Network(e405aa5a-b440-40a0-bec7-796676ed00a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59532faa-7c')
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] No VIF found with MAC fa:16:3e:c6:2c:81, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:07:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:08 user nova-compute[75293]: DEBUG nova.network.neutron [req-f24d93ae-b1e8-4417-af36-d95de05d78b0 req-b28ce824-fb65-4b67-b486-f165f7674ba8 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Updated VIF entry in instance network info cache for port 7cf6968f-9b43-4e24-9ade-d296716616fe. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:07:08 user nova-compute[75293]: DEBUG nova.network.neutron [req-f24d93ae-b1e8-4417-af36-d95de05d78b0 req-b28ce824-fb65-4b67-b486-f165f7674ba8 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Updating instance_info_cache with network_info: [{"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:07:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f24d93ae-b1e8-4417-af36-d95de05d78b0 req-b28ce824-fb65-4b67-b486-f165f7674ba8 service nova] Releasing lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:07:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Acquiring lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:12 user nova-compute[75293]: DEBUG nova.compute.manager [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:07:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:12 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:07:12 user nova-compute[75293]: INFO nova.compute.claims [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Claim successful on node user
Nov 30 07:07:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:12 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:07:12 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:07:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:13 user nova-compute[75293]: DEBUG nova.compute.manager [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:07:13 user nova-compute[75293]: DEBUG nova.compute.manager [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:07:13 user nova-compute[75293]: DEBUG nova.network.neutron [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:07:13 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 30 07:07:13 user nova-compute[75293]: DEBUG nova.compute.manager [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:07:13 user nova-compute[75293]: DEBUG nova.compute.manager [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:07:13 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:07:13 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Creating image(s)
Nov 30 07:07:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "/opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "/opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Acquiring lock "9af493c8d811416bf31374eb71c4b7de4f214a53" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "9af493c8d811416bf31374eb71c4b7de4f214a53" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:13 user nova-compute[75293]: DEBUG nova.policy [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '302dc033f6814d5297e9fdaf59b1c5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2dd909b1384539ac2fa74ece5501f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:07:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9af493c8d811416bf31374eb71c4b7de4f214a53.part --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9af493c8d811416bf31374eb71c4b7de4f214a53.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.images [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] 3bbfba9e-7023-48a8-87f3-49f8c7d1ac27 was qcow2, converting to raw {{(pid=75293) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.privsep.utils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75293) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9af493c8d811416bf31374eb71c4b7de4f214a53.part /opt/stack/data/nova/instances/_base/9af493c8d811416bf31374eb71c4b7de4f214a53.converted {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.compute.manager [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:07:14 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Instance spawned successfully.
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.compute.manager [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:07:14 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Instance spawned successfully.
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9af493c8d811416bf31374eb71c4b7de4f214a53.part /opt/stack/data/nova/instances/_base/9af493c8d811416bf31374eb71c4b7de4f214a53.converted" returned: 0 in 0.298s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9af493c8d811416bf31374eb71c4b7de4f214a53.converted --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.compute.manager [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:07:14 user nova-compute[75293]: INFO nova.compute.manager [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Took 13.87 seconds to spawn the instance on the hypervisor.
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.compute.manager [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:07:14 user nova-compute[75293]: INFO nova.compute.manager [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Took 15.30 seconds to spawn the instance on the hypervisor.
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.compute.manager [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Acquiring lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.compute.manager [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:07:14 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Instance spawned successfully.
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9af493c8d811416bf31374eb71c4b7de4f214a53.converted --force-share --output=json" returned: 0 in 0.253s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "9af493c8d811416bf31374eb71c4b7de4f214a53" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.218s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9af493c8d811416bf31374eb71c4b7de4f214a53 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:14 user nova-compute[75293]: INFO nova.compute.manager [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Took 15.41 seconds to build instance.
Nov 30 07:07:14 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:07:14 user nova-compute[75293]: INFO nova.compute.claims [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Claim successful on node user
Nov 30 07:07:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-503aa23e-189b-4798-8bcf-64a68a59dbed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "251604ac-b300-49ae-ae1a-4543665fead6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.561s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:14 user nova-compute[75293]: INFO nova.compute.manager [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Took 16.28 seconds to build instance.
Nov 30 07:07:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9af493c8d811416bf31374eb71c4b7de4f214a53 --force-share --output=json" returned: 0 in 0.243s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Acquiring lock "9af493c8d811416bf31374eb71c4b7de4f214a53" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "9af493c8d811416bf31374eb71c4b7de4f214a53" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9af493c8d811416bf31374eb71c4b7de4f214a53 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:15 user nova-compute[75293]: INFO nova.compute.manager [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Took 14.64 seconds to spawn the instance on the hypervisor.
Nov 30 07:07:15 user nova-compute[75293]: DEBUG nova.compute.manager [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:07:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-04c1e23d-9941-4535-abce-3150043c86b9 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.738s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:15 user nova-compute[75293]: INFO nova.compute.manager [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Took 16.49 seconds to build instance.
Nov 30 07:07:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9af493c8d811416bf31374eb71c4b7de4f214a53 --force-share --output=json" returned: 0 in 0.405s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9af493c8d811416bf31374eb71c4b7de4f214a53,backing_fmt=raw /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de35c3f9-bd53-4a33-93e7-3a5f407cae42 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "1b7deb0a-39af-4d93-b93d-5765a731f702" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.717s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9af493c8d811416bf31374eb71c4b7de4f214a53,backing_fmt=raw /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk 1073741824" returned: 0 in 0.117s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "9af493c8d811416bf31374eb71c4b7de4f214a53" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.525s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9af493c8d811416bf31374eb71c4b7de4f214a53 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:15 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:07:15 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:07:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9af493c8d811416bf31374eb71c4b7de4f214a53 --force-share --output=json" returned: 0 in 0.249s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:15 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:07:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.014s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:15 user nova-compute[75293]: DEBUG nova.compute.manager [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:07:15 user nova-compute[75293]: DEBUG nova.compute.manager [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:07:15 user nova-compute[75293]: DEBUG nova.network.neutron [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:07:15 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:07:15 user nova-compute[75293]: DEBUG nova.compute.manager [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Cannot resize image /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Ensure instance console log exists: /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG nova.policy [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f2845232e8441c482acdb2c5f63c389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a232105c95a42669fd04b62416ded2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG nova.compute.manager [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:07:16 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Creating image(s)
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "/opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "/opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG nova.network.neutron [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Successfully created port: 53964f53-7286-4710-bc56-709f3d460ba2 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.235s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "061832ab-930a-470b-8b4f-dfc8f19fea6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.221s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk 1073741824" returned: 0 in 0.069s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:16 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:07:16 user nova-compute[75293]: INFO nova.compute.claims [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Claim successful on node user
Nov 30 07:07:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.247s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk --force-share --output=json" returned: 0 in 0.330s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Cannot resize image /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Ensure instance console log exists: /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.626s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:07:17 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:07:17 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG nova.policy [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a489452874654d99ba7f7b68eb62d30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba486b18243b4462a2a4c35b6c478a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:07:17 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Creating image(s)
Nov 30 07:07:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "/opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "/opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "/opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.124s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.242s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.265s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk 1073741824" returned: 0 in 0.087s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.361s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:18 user nova-compute[75293]: DEBUG nova.network.neutron [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Successfully created port: 60fdc1a9-8616-40a3-9380-b675ff1b3239 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:07:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.282s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:18 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Checking if we can resize image /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:07:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:19 user nova-compute[75293]: DEBUG nova.network.neutron [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Successfully updated port: 53964f53-7286-4710-bc56-709f3d460ba2 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:07:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:19 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Cannot resize image /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:07:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:07:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Ensure instance console log exists: /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:07:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Acquiring lock "refresh_cache-bb71c604-7f7e-4b71-8fa3-56bd77b649c3" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:07:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Acquired lock "refresh_cache-bb71c604-7f7e-4b71-8fa3-56bd77b649c3" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:07:19 user nova-compute[75293]: DEBUG nova.network.neutron [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:07:19 user nova-compute[75293]: DEBUG nova.compute.manager [req-dbad3df4-cb18-4c1e-a342-cdcab5cb5706 req-98c834eb-0be9-45e3-97d6-9217acda7adf service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Received event network-changed-53964f53-7286-4710-bc56-709f3d460ba2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:19 user nova-compute[75293]: DEBUG nova.compute.manager [req-dbad3df4-cb18-4c1e-a342-cdcab5cb5706 req-98c834eb-0be9-45e3-97d6-9217acda7adf service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Refreshing instance network info cache due to event network-changed-53964f53-7286-4710-bc56-709f3d460ba2. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:07:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-dbad3df4-cb18-4c1e-a342-cdcab5cb5706 req-98c834eb-0be9-45e3-97d6-9217acda7adf service nova] Acquiring lock "refresh_cache-bb71c604-7f7e-4b71-8fa3-56bd77b649c3" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:07:19 user nova-compute[75293]: DEBUG nova.network.neutron [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:07:19 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Successfully created port: 693d3de2-b91f-4efb-9e5e-2281d858ec0b {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.network.neutron [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Updating instance_info_cache with network_info: [{"id": "53964f53-7286-4710-bc56-709f3d460ba2", "address": "fa:16:3e:f7:a6:d9", "network": {"id": "3a2529a8-0610-4c6a-8844-84b457a6e027", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1879734062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2dd909b1384539ac2fa74ece5501f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53964f53-72", "ovs_interfaceid": "53964f53-7286-4710-bc56-709f3d460ba2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Releasing lock "refresh_cache-bb71c604-7f7e-4b71-8fa3-56bd77b649c3" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.compute.manager [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Instance network_info: |[{"id": "53964f53-7286-4710-bc56-709f3d460ba2", "address": "fa:16:3e:f7:a6:d9", "network": {"id": "3a2529a8-0610-4c6a-8844-84b457a6e027", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1879734062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2dd909b1384539ac2fa74ece5501f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53964f53-72", "ovs_interfaceid": "53964f53-7286-4710-bc56-709f3d460ba2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-dbad3df4-cb18-4c1e-a342-cdcab5cb5706 req-98c834eb-0be9-45e3-97d6-9217acda7adf service nova] Acquired lock "refresh_cache-bb71c604-7f7e-4b71-8fa3-56bd77b649c3" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.network.neutron [req-dbad3df4-cb18-4c1e-a342-cdcab5cb5706 req-98c834eb-0be9-45e3-97d6-9217acda7adf service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Refreshing network info cache for port 53964f53-7286-4710-bc56-709f3d460ba2 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Start _get_guest_xml network_info=[{"id": "53964f53-7286-4710-bc56-709f3d460ba2", "address": "fa:16:3e:f7:a6:d9", "network": {"id": "3a2529a8-0610-4c6a-8844-84b457a6e027", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1879734062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2dd909b1384539ac2fa74ece5501f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53964f53-72", "ovs_interfaceid": "53964f53-7286-4710-bc56-709f3d460ba2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:07:06Z,direct_url=<?>,disk_format='qcow2',id=3bbfba9e-7023-48a8-87f3-49f8c7d1ac27,min_disk=0,min_ram=0,name='',owner='67b9bdd51f9d44f5bf30dcdb6428fb1a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/sda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '3bbfba9e-7023-48a8-87f3-49f8c7d1ac27'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:07:20 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:20 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:07:06Z,direct_url=<?>,disk_format='qcow2',id=3bbfba9e-7023-48a8-87f3-49f8c7d1ac27,min_disk=0,min_ram=0,name='',owner='67b9bdd51f9d44f5bf30dcdb6428fb1a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-384242228',display_name='tempest-AttachSCSIVolumeTestJSON-server-384242228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-384242228',id=4,image_ref='3bbfba9e-7023-48a8-87f3-49f8c7d1ac27',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEB4DdRyKUH8rA6Sm+odCzPLcFyMIGAUoYhVLgX2CbXaozUldlryipSJ5qwH1YT4pB+ZJ2fuL71tCKnJIq/6GjOvzfv+QB5mzXLHSCNLXFbMCG5vVAIkX5aCCW5H1vIvzQ==',key_name='tempest-keypair-1461044521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d2dd909b1384539ac2fa74ece5501f2',ramdisk_id='',reservation_id='r-ib7jor2j',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3bbfba9e-7023-48a8-87f3-49f8c7d1ac27',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-753889653',owner_user_name='tempest-AttachSCSIVolumeTestJSON-753889653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302dc033f6814d5297e9fdaf59b1c5e7',uuid=bb71c604-7f7e-4b71-8fa3-56bd77b649c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53964f53-7286-4710-bc56-709f3d460ba2", "address": "fa:16:3e:f7:a6:d9", "network": {"id": "3a2529a8-0610-4c6a-8844-84b457a6e027", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1879734062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2dd909b1384539ac2fa74ece5501f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53964f53-72", "ovs_interfaceid": "53964f53-7286-4710-bc56-709f3d460ba2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Converting VIF {"id": "53964f53-7286-4710-bc56-709f3d460ba2", "address": "fa:16:3e:f7:a6:d9", "network": {"id": "3a2529a8-0610-4c6a-8844-84b457a6e027", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1879734062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2dd909b1384539ac2fa74ece5501f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53964f53-72", "ovs_interfaceid": "53964f53-7286-4710-bc56-709f3d460ba2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a6:d9,bridge_name='br-int',has_traffic_filtering=True,id=53964f53-7286-4710-bc56-709f3d460ba2,network=Network(3a2529a8-0610-4c6a-8844-84b457a6e027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53964f53-72') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.objects.instance [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lazy-loading 'pci_devices' on Instance uuid bb71c604-7f7e-4b71-8fa3-56bd77b649c3 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:07:20 user nova-compute[75293]:   <uuid>bb71c604-7f7e-4b71-8fa3-56bd77b649c3</uuid>
Nov 30 07:07:20 user nova-compute[75293]:   <name>instance-00000004</name>
Nov 30 07:07:20 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:07:20 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:07:20 user nova-compute[75293]:   <metadata>
Nov 30 07:07:20 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:07:20 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:07:20 user nova-compute[75293]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-384242228</nova:name>
Nov 30 07:07:20 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:07:20</nova:creationTime>
Nov 30 07:07:20 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:07:20 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:07:20 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:07:20 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:07:20 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:07:20 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:07:20 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:07:20 user nova-compute[75293]:       <nova:owner>
Nov 30 07:07:20 user nova-compute[75293]:         <nova:user uuid="302dc033f6814d5297e9fdaf59b1c5e7">tempest-AttachSCSIVolumeTestJSON-753889653-project-member</nova:user>
Nov 30 07:07:20 user nova-compute[75293]:         <nova:project uuid="6d2dd909b1384539ac2fa74ece5501f2">tempest-AttachSCSIVolumeTestJSON-753889653</nova:project>
Nov 30 07:07:20 user nova-compute[75293]:       </nova:owner>
Nov 30 07:07:20 user nova-compute[75293]:       <nova:root type="image" uuid="3bbfba9e-7023-48a8-87f3-49f8c7d1ac27"/>
Nov 30 07:07:20 user nova-compute[75293]:       <nova:ports>
Nov 30 07:07:20 user nova-compute[75293]:         <nova:port uuid="53964f53-7286-4710-bc56-709f3d460ba2">
Nov 30 07:07:20 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 07:07:20 user nova-compute[75293]:         </nova:port>
Nov 30 07:07:20 user nova-compute[75293]:       </nova:ports>
Nov 30 07:07:20 user nova-compute[75293]:     </nova:instance>
Nov 30 07:07:20 user nova-compute[75293]:   </metadata>
Nov 30 07:07:20 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:07:20 user nova-compute[75293]:     <system>
Nov 30 07:07:20 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:07:20 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:07:20 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:07:20 user nova-compute[75293]:       <entry name="serial">bb71c604-7f7e-4b71-8fa3-56bd77b649c3</entry>
Nov 30 07:07:20 user nova-compute[75293]:       <entry name="uuid">bb71c604-7f7e-4b71-8fa3-56bd77b649c3</entry>
Nov 30 07:07:20 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:07:20 user nova-compute[75293]:     </system>
Nov 30 07:07:20 user nova-compute[75293]:   </sysinfo>
Nov 30 07:07:20 user nova-compute[75293]:   <os>
Nov 30 07:07:20 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:07:20 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:07:20 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:07:20 user nova-compute[75293]:   </os>
Nov 30 07:07:20 user nova-compute[75293]:   <features>
Nov 30 07:07:20 user nova-compute[75293]:     <acpi/>
Nov 30 07:07:20 user nova-compute[75293]:     <apic/>
Nov 30 07:07:20 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:07:20 user nova-compute[75293]:   </features>
Nov 30 07:07:20 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:07:20 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:07:20 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:07:20 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:07:20 user nova-compute[75293]:   </clock>
Nov 30 07:07:20 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:07:20 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:07:20 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:07:20 user nova-compute[75293]:   </cpu>
Nov 30 07:07:20 user nova-compute[75293]:   <devices>
Nov 30 07:07:20 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:07:20 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:07:20 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk"/>
Nov 30 07:07:20 user nova-compute[75293]:       <target dev="sda" bus="scsi"/>
Nov 30 07:07:20 user nova-compute[75293]:       <address type="drive" controller="0" unit="0"/>
Nov 30 07:07:20 user nova-compute[75293]:     </disk>
Nov 30 07:07:20 user nova-compute[75293]:     <disk type="file" device="cdrom">
Nov 30 07:07:20 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none"/>
Nov 30 07:07:20 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk.config"/>
Nov 30 07:07:20 user nova-compute[75293]:       <target dev="sdb" bus="scsi"/>
Nov 30 07:07:20 user nova-compute[75293]:       <address type="drive" controller="0" unit="1"/>
Nov 30 07:07:20 user nova-compute[75293]:     </disk>
Nov 30 07:07:20 user nova-compute[75293]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 30 07:07:20 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:07:20 user nova-compute[75293]:       <mac address="fa:16:3e:f7:a6:d9"/>
Nov 30 07:07:20 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:07:20 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:07:20 user nova-compute[75293]:       <target dev="tap53964f53-72"/>
Nov 30 07:07:20 user nova-compute[75293]:     </interface>
Nov 30 07:07:20 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:07:20 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/console.log" append="off"/>
Nov 30 07:07:20 user nova-compute[75293]:     </serial>
Nov 30 07:07:20 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:07:20 user nova-compute[75293]:     <video>
Nov 30 07:07:20 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:07:20 user nova-compute[75293]:     </video>
Nov 30 07:07:20 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:07:20 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:07:20 user nova-compute[75293]:     </rng>
Nov 30 07:07:20 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:07:20 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:07:20 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:07:20 user nova-compute[75293]:     </memballoon>
Nov 30 07:07:20 user nova-compute[75293]:   </devices>
Nov 30 07:07:20 user nova-compute[75293]: </domain>
Nov 30 07:07:20 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-384242228',display_name='tempest-AttachSCSIVolumeTestJSON-server-384242228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-384242228',id=4,image_ref='3bbfba9e-7023-48a8-87f3-49f8c7d1ac27',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEB4DdRyKUH8rA6Sm+odCzPLcFyMIGAUoYhVLgX2CbXaozUldlryipSJ5qwH1YT4pB+ZJ2fuL71tCKnJIq/6GjOvzfv+QB5mzXLHSCNLXFbMCG5vVAIkX5aCCW5H1vIvzQ==',key_name='tempest-keypair-1461044521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d2dd909b1384539ac2fa74ece5501f2',ramdisk_id='',reservation_id='r-ib7jor2j',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3bbfba9e-7023-48a8-87f3-49f8c7d1ac27',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-753889653',owner_user_name='tempest-AttachSCSIVolumeTestJSON-753889653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302dc033f6814d5297e9fdaf59b1c5e7',uuid=bb71c604-7f7e-4b71-8fa3-56bd77b649c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53964f53-7286-4710-bc56-709f3d460ba2", "address": "fa:16:3e:f7:a6:d9", "network": {"id": "3a2529a8-0610-4c6a-8844-84b457a6e027", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1879734062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2dd909b1384539ac2fa74ece5501f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53964f53-72", "ovs_interfaceid": "53964f53-7286-4710-bc56-709f3d460ba2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Converting VIF {"id": "53964f53-7286-4710-bc56-709f3d460ba2", "address": "fa:16:3e:f7:a6:d9", "network": {"id": "3a2529a8-0610-4c6a-8844-84b457a6e027", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1879734062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2dd909b1384539ac2fa74ece5501f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53964f53-72", "ovs_interfaceid": "53964f53-7286-4710-bc56-709f3d460ba2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a6:d9,bridge_name='br-int',has_traffic_filtering=True,id=53964f53-7286-4710-bc56-709f3d460ba2,network=Network(3a2529a8-0610-4c6a-8844-84b457a6e027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53964f53-72') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG os_vif [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a6:d9,bridge_name='br-int',has_traffic_filtering=True,id=53964f53-7286-4710-bc56-709f3d460ba2,network=Network(3a2529a8-0610-4c6a-8844-84b457a6e027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53964f53-72') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c156fe72-b719-54a8-ba1f-b65471835cd3', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53964f53-72, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53964f53-72, col_values=(('qos', UUID('bd28903a-3ddf-4dfe-8eb9-7f281b454ccf')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53964f53-72, col_values=(('external_ids', {'iface-id': '53964f53-7286-4710-bc56-709f3d460ba2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:a6:d9', 'vm-uuid': 'bb71c604-7f7e-4b71-8fa3-56bd77b649c3'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:20 user nova-compute[75293]: INFO os_vif [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:a6:d9,bridge_name='br-int',has_traffic_filtering=True,id=53964f53-7286-4710-bc56-709f3d460ba2,network=Network(3a2529a8-0610-4c6a-8844-84b457a6e027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53964f53-72')
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] No BDM found with device name sda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] No VIF found with MAC fa:16:3e:f7:a6:d9, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:07:20 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Using config drive
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.network.neutron [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Successfully updated port: 60fdc1a9-8616-40a3-9380-b675ff1b3239 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Acquiring lock "refresh_cache-dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Acquired lock "refresh_cache-dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.network.neutron [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:07:20 user nova-compute[75293]: DEBUG nova.network.neutron [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Successfully updated port: 693d3de2-b91f-4efb-9e5e-2281d858ec0b {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "refresh_cache-061832ab-930a-470b-8b4f-dfc8f19fea6b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquired lock "refresh_cache-061832ab-930a-470b-8b4f-dfc8f19fea6b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.compute.manager [req-b5ada992-3d6b-4548-9454-f133fb39d487 req-2445d9ec-c205-4fd0-a224-96bfda91f3b6 service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Received event network-changed-693d3de2-b91f-4efb-9e5e-2281d858ec0b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.compute.manager [req-b5ada992-3d6b-4548-9454-f133fb39d487 req-2445d9ec-c205-4fd0-a224-96bfda91f3b6 service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Refreshing instance network info cache due to event network-changed-693d3de2-b91f-4efb-9e5e-2281d858ec0b. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b5ada992-3d6b-4548-9454-f133fb39d487 req-2445d9ec-c205-4fd0-a224-96bfda91f3b6 service nova] Acquiring lock "refresh_cache-061832ab-930a-470b-8b4f-dfc8f19fea6b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.compute.manager [req-26cb533f-5e88-4ba4-989c-298232e45406 req-dbb8aa6b-c0e4-468b-a3b4-4f2f0659f355 service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Received event network-changed-60fdc1a9-8616-40a3-9380-b675ff1b3239 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.compute.manager [req-26cb533f-5e88-4ba4-989c-298232e45406 req-dbb8aa6b-c0e4-468b-a3b4-4f2f0659f355 service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Refreshing instance network info cache due to event network-changed-60fdc1a9-8616-40a3-9380-b675ff1b3239. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-26cb533f-5e88-4ba4-989c-298232e45406 req-dbb8aa6b-c0e4-468b-a3b4-4f2f0659f355 service nova] Acquiring lock "refresh_cache-dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.network.neutron [req-dbad3df4-cb18-4c1e-a342-cdcab5cb5706 req-98c834eb-0be9-45e3-97d6-9217acda7adf service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Updated VIF entry in instance network info cache for port 53964f53-7286-4710-bc56-709f3d460ba2. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.network.neutron [req-dbad3df4-cb18-4c1e-a342-cdcab5cb5706 req-98c834eb-0be9-45e3-97d6-9217acda7adf service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Updating instance_info_cache with network_info: [{"id": "53964f53-7286-4710-bc56-709f3d460ba2", "address": "fa:16:3e:f7:a6:d9", "network": {"id": "3a2529a8-0610-4c6a-8844-84b457a6e027", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1879734062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2dd909b1384539ac2fa74ece5501f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53964f53-72", "ovs_interfaceid": "53964f53-7286-4710-bc56-709f3d460ba2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-dbad3df4-cb18-4c1e-a342-cdcab5cb5706 req-98c834eb-0be9-45e3-97d6-9217acda7adf service nova] Releasing lock "refresh_cache-bb71c604-7f7e-4b71-8fa3-56bd77b649c3" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Updating instance_info_cache with network_info: [{"id": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "address": "fa:16:3e:0a:7f:0a", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693d3de2-b9", "ovs_interfaceid": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Releasing lock "refresh_cache-061832ab-930a-470b-8b4f-dfc8f19fea6b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Instance network_info: |[{"id": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "address": "fa:16:3e:0a:7f:0a", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693d3de2-b9", "ovs_interfaceid": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b5ada992-3d6b-4548-9454-f133fb39d487 req-2445d9ec-c205-4fd0-a224-96bfda91f3b6 service nova] Acquired lock "refresh_cache-061832ab-930a-470b-8b4f-dfc8f19fea6b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.network.neutron [req-b5ada992-3d6b-4548-9454-f133fb39d487 req-2445d9ec-c205-4fd0-a224-96bfda91f3b6 service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Refreshing network info cache for port 693d3de2-b91f-4efb-9e5e-2281d858ec0b {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Start _get_guest_xml network_info=[{"id": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "address": "fa:16:3e:0a:7f:0a", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693d3de2-b9", "ovs_interfaceid": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:07:21 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:21 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-102239067',display_name='tempest-VolumesAdminNegativeTest-server-102239067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-102239067',id=6,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACU6svB3YUMbNXIz/g7yGwOGofvLSdRzbQ+0xWSRtwQ0cZ7gAJYQyYxnEvAColQINlEJ9gNredWz6zWyN6EbMTtSNFJBZVxxAbqU3rHzA09mnSlfhATReQwh/oT5LkxDQ==',key_name='tempest-keypair-2033360921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba486b18243b4462a2a4c35b6c478a0a',ramdisk_id='',reservation_id='r-ptt1l5ow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1001198017',owner_user_name='tempest-VolumesAdminNegativeTest-1001198017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a489452874654d99ba7f7b68eb62d30b',uuid=061832ab-930a-470b-8b4f-dfc8f19fea6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "address": "fa:16:3e:0a:7f:0a", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693d3de2-b9", "ovs_interfaceid": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Converting VIF {"id": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "address": "fa:16:3e:0a:7f:0a", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693d3de2-b9", "ovs_interfaceid": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:7f:0a,bridge_name='br-int',has_traffic_filtering=True,id=693d3de2-b91f-4efb-9e5e-2281d858ec0b,network=Network(43e6a947-eef6-4e52-afaf-c2defb3200b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693d3de2-b9') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.objects.instance [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lazy-loading 'pci_devices' on Instance uuid 061832ab-930a-470b-8b4f-dfc8f19fea6b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:07:21 user nova-compute[75293]:   <uuid>061832ab-930a-470b-8b4f-dfc8f19fea6b</uuid>
Nov 30 07:07:21 user nova-compute[75293]:   <name>instance-00000006</name>
Nov 30 07:07:21 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:07:21 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:07:21 user nova-compute[75293]:   <metadata>
Nov 30 07:07:21 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:07:21 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:07:21 user nova-compute[75293]:       <nova:name>tempest-VolumesAdminNegativeTest-server-102239067</nova:name>
Nov 30 07:07:21 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:07:21</nova:creationTime>
Nov 30 07:07:21 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:07:21 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:07:21 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:07:21 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:07:21 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:07:21 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:07:21 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:07:21 user nova-compute[75293]:       <nova:owner>
Nov 30 07:07:21 user nova-compute[75293]:         <nova:user uuid="a489452874654d99ba7f7b68eb62d30b">tempest-VolumesAdminNegativeTest-1001198017-project-member</nova:user>
Nov 30 07:07:21 user nova-compute[75293]:         <nova:project uuid="ba486b18243b4462a2a4c35b6c478a0a">tempest-VolumesAdminNegativeTest-1001198017</nova:project>
Nov 30 07:07:21 user nova-compute[75293]:       </nova:owner>
Nov 30 07:07:21 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:07:21 user nova-compute[75293]:       <nova:ports>
Nov 30 07:07:21 user nova-compute[75293]:         <nova:port uuid="693d3de2-b91f-4efb-9e5e-2281d858ec0b">
Nov 30 07:07:21 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 07:07:21 user nova-compute[75293]:         </nova:port>
Nov 30 07:07:21 user nova-compute[75293]:       </nova:ports>
Nov 30 07:07:21 user nova-compute[75293]:     </nova:instance>
Nov 30 07:07:21 user nova-compute[75293]:   </metadata>
Nov 30 07:07:21 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:07:21 user nova-compute[75293]:     <system>
Nov 30 07:07:21 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:07:21 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:07:21 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:07:21 user nova-compute[75293]:       <entry name="serial">061832ab-930a-470b-8b4f-dfc8f19fea6b</entry>
Nov 30 07:07:21 user nova-compute[75293]:       <entry name="uuid">061832ab-930a-470b-8b4f-dfc8f19fea6b</entry>
Nov 30 07:07:21 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:07:21 user nova-compute[75293]:     </system>
Nov 30 07:07:21 user nova-compute[75293]:   </sysinfo>
Nov 30 07:07:21 user nova-compute[75293]:   <os>
Nov 30 07:07:21 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:07:21 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:07:21 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:07:21 user nova-compute[75293]:   </os>
Nov 30 07:07:21 user nova-compute[75293]:   <features>
Nov 30 07:07:21 user nova-compute[75293]:     <acpi/>
Nov 30 07:07:21 user nova-compute[75293]:     <apic/>
Nov 30 07:07:21 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:07:21 user nova-compute[75293]:   </features>
Nov 30 07:07:21 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:07:21 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:07:21 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:07:21 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:07:21 user nova-compute[75293]:   </clock>
Nov 30 07:07:21 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:07:21 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:07:21 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:07:21 user nova-compute[75293]:   </cpu>
Nov 30 07:07:21 user nova-compute[75293]:   <devices>
Nov 30 07:07:21 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:07:21 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:07:21 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk"/>
Nov 30 07:07:21 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:07:21 user nova-compute[75293]:     </disk>
Nov 30 07:07:21 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:07:21 user nova-compute[75293]:       <mac address="fa:16:3e:0a:7f:0a"/>
Nov 30 07:07:21 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:07:21 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:07:21 user nova-compute[75293]:       <target dev="tap693d3de2-b9"/>
Nov 30 07:07:21 user nova-compute[75293]:     </interface>
Nov 30 07:07:21 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:07:21 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/console.log" append="off"/>
Nov 30 07:07:21 user nova-compute[75293]:     </serial>
Nov 30 07:07:21 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:07:21 user nova-compute[75293]:     <video>
Nov 30 07:07:21 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:07:21 user nova-compute[75293]:     </video>
Nov 30 07:07:21 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:07:21 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:07:21 user nova-compute[75293]:     </rng>
Nov 30 07:07:21 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:07:21 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:07:21 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:07:21 user nova-compute[75293]:     </memballoon>
Nov 30 07:07:21 user nova-compute[75293]:   </devices>
Nov 30 07:07:21 user nova-compute[75293]: </domain>
Nov 30 07:07:21 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-102239067',display_name='tempest-VolumesAdminNegativeTest-server-102239067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-102239067',id=6,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACU6svB3YUMbNXIz/g7yGwOGofvLSdRzbQ+0xWSRtwQ0cZ7gAJYQyYxnEvAColQINlEJ9gNredWz6zWyN6EbMTtSNFJBZVxxAbqU3rHzA09mnSlfhATReQwh/oT5LkxDQ==',key_name='tempest-keypair-2033360921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba486b18243b4462a2a4c35b6c478a0a',ramdisk_id='',reservation_id='r-ptt1l5ow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1001198017',owner_user_name='tempest-VolumesAdminNegativeTest-1001198017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a489452874654d99ba7f7b68eb62d30b',uuid=061832ab-930a-470b-8b4f-dfc8f19fea6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "address": "fa:16:3e:0a:7f:0a", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693d3de2-b9", "ovs_interfaceid": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Converting VIF {"id": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "address": "fa:16:3e:0a:7f:0a", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693d3de2-b9", "ovs_interfaceid": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:7f:0a,bridge_name='br-int',has_traffic_filtering=True,id=693d3de2-b91f-4efb-9e5e-2281d858ec0b,network=Network(43e6a947-eef6-4e52-afaf-c2defb3200b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693d3de2-b9') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG os_vif [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:7f:0a,bridge_name='br-int',has_traffic_filtering=True,id=693d3de2-b91f-4efb-9e5e-2281d858ec0b,network=Network(43e6a947-eef6-4e52-afaf-c2defb3200b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693d3de2-b9') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8054c02-2939-50d6-9c41-b46821a0e0e1', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap693d3de2-b9, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap693d3de2-b9, col_values=(('qos', UUID('5babd1df-9c68-47ce-8be6-9e67ccb3f113')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap693d3de2-b9, col_values=(('external_ids', {'iface-id': '693d3de2-b91f-4efb-9e5e-2281d858ec0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:7f:0a', 'vm-uuid': '061832ab-930a-470b-8b4f-dfc8f19fea6b'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:22 user nova-compute[75293]: INFO os_vif [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:7f:0a,bridge_name='br-int',has_traffic_filtering=True,id=693d3de2-b91f-4efb-9e5e-2281d858ec0b,network=Network(43e6a947-eef6-4e52-afaf-c2defb3200b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693d3de2-b9')
Nov 30 07:07:22 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Creating config drive at /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk.config
Nov 30 07:07:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1z6gwsol {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] No VIF found with MAC fa:16:3e:0a:7f:0a, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1z6gwsol" returned: 0 in 0.090s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.network.neutron [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Updating instance_info_cache with network_info: [{"id": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "address": "fa:16:3e:70:14:32", "network": {"id": "874f6f69-e233-46c8-b3a1-1e056bb291f2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1191377101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a232105c95a42669fd04b62416ded2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fdc1a9-86", "ovs_interfaceid": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Releasing lock "refresh_cache-dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.compute.manager [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Instance network_info: |[{"id": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "address": "fa:16:3e:70:14:32", "network": {"id": "874f6f69-e233-46c8-b3a1-1e056bb291f2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1191377101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a232105c95a42669fd04b62416ded2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fdc1a9-86", "ovs_interfaceid": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-26cb533f-5e88-4ba4-989c-298232e45406 req-dbb8aa6b-c0e4-468b-a3b4-4f2f0659f355 service nova] Acquired lock "refresh_cache-dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.network.neutron [req-26cb533f-5e88-4ba4-989c-298232e45406 req-dbb8aa6b-c0e4-468b-a3b4-4f2f0659f355 service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Refreshing network info cache for port 60fdc1a9-8616-40a3-9380-b675ff1b3239 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Start _get_guest_xml network_info=[{"id": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "address": "fa:16:3e:70:14:32", "network": {"id": "874f6f69-e233-46c8-b3a1-1e056bb291f2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1191377101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a232105c95a42669fd04b62416ded2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fdc1a9-86", "ovs_interfaceid": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:07:22 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:22 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1302031079',display_name='tempest-TestVolumeSwap-server-1302031079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1302031079',id=5,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEzAcOrRtFHkoAWbWt7bFOGLuIJulXu3F2Rz6BqNzmgRnIqDla3n+ON4yPeNFaHU726QsCAmpkKL0hIZihRliyV4fmnhMaE0VqV2GeKMLAZCdr/4eXXrC4GjDu04gyfaQ==',key_name='tempest-keypair-1061253891',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a232105c95a42669fd04b62416ded2f',ramdisk_id='',reservation_id='r-aohjr03f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1605433774',owner_user_name='tempest-TestVolumeSwap-1605433774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:07:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f2845232e8441c482acdb2c5f63c389',uuid=dcd1ca28-3784-45b3-a3d3-e3231d8e82bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "address": "fa:16:3e:70:14:32", "network": {"id": "874f6f69-e233-46c8-b3a1-1e056bb291f2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1191377101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a232105c95a42669fd04b62416ded2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fdc1a9-86", "ovs_interfaceid": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Converting VIF {"id": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "address": "fa:16:3e:70:14:32", "network": {"id": "874f6f69-e233-46c8-b3a1-1e056bb291f2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1191377101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a232105c95a42669fd04b62416ded2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fdc1a9-86", "ovs_interfaceid": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:14:32,bridge_name='br-int',has_traffic_filtering=True,id=60fdc1a9-8616-40a3-9380-b675ff1b3239,network=Network(874f6f69-e233-46c8-b3a1-1e056bb291f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60fdc1a9-86') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.objects.instance [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lazy-loading 'pci_devices' on Instance uuid dcd1ca28-3784-45b3-a3d3-e3231d8e82bb {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:07:22 user nova-compute[75293]:   <uuid>dcd1ca28-3784-45b3-a3d3-e3231d8e82bb</uuid>
Nov 30 07:07:22 user nova-compute[75293]:   <name>instance-00000005</name>
Nov 30 07:07:22 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:07:22 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:07:22 user nova-compute[75293]:   <metadata>
Nov 30 07:07:22 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:07:22 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:07:22 user nova-compute[75293]:       <nova:name>tempest-TestVolumeSwap-server-1302031079</nova:name>
Nov 30 07:07:22 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:07:22</nova:creationTime>
Nov 30 07:07:22 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:07:22 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:07:22 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:07:22 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:07:22 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:07:22 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:07:22 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:07:22 user nova-compute[75293]:       <nova:owner>
Nov 30 07:07:22 user nova-compute[75293]:         <nova:user uuid="4f2845232e8441c482acdb2c5f63c389">tempest-TestVolumeSwap-1605433774-project-member</nova:user>
Nov 30 07:07:22 user nova-compute[75293]:         <nova:project uuid="2a232105c95a42669fd04b62416ded2f">tempest-TestVolumeSwap-1605433774</nova:project>
Nov 30 07:07:22 user nova-compute[75293]:       </nova:owner>
Nov 30 07:07:22 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:07:22 user nova-compute[75293]:       <nova:ports>
Nov 30 07:07:22 user nova-compute[75293]:         <nova:port uuid="60fdc1a9-8616-40a3-9380-b675ff1b3239">
Nov 30 07:07:22 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 07:07:22 user nova-compute[75293]:         </nova:port>
Nov 30 07:07:22 user nova-compute[75293]:       </nova:ports>
Nov 30 07:07:22 user nova-compute[75293]:     </nova:instance>
Nov 30 07:07:22 user nova-compute[75293]:   </metadata>
Nov 30 07:07:22 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:07:22 user nova-compute[75293]:     <system>
Nov 30 07:07:22 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:07:22 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:07:22 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:07:22 user nova-compute[75293]:       <entry name="serial">dcd1ca28-3784-45b3-a3d3-e3231d8e82bb</entry>
Nov 30 07:07:22 user nova-compute[75293]:       <entry name="uuid">dcd1ca28-3784-45b3-a3d3-e3231d8e82bb</entry>
Nov 30 07:07:22 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:07:22 user nova-compute[75293]:     </system>
Nov 30 07:07:22 user nova-compute[75293]:   </sysinfo>
Nov 30 07:07:22 user nova-compute[75293]:   <os>
Nov 30 07:07:22 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:07:22 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:07:22 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:07:22 user nova-compute[75293]:   </os>
Nov 30 07:07:22 user nova-compute[75293]:   <features>
Nov 30 07:07:22 user nova-compute[75293]:     <acpi/>
Nov 30 07:07:22 user nova-compute[75293]:     <apic/>
Nov 30 07:07:22 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:07:22 user nova-compute[75293]:   </features>
Nov 30 07:07:22 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:07:22 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:07:22 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:07:22 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:07:22 user nova-compute[75293]:   </clock>
Nov 30 07:07:22 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:07:22 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:07:22 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:07:22 user nova-compute[75293]:   </cpu>
Nov 30 07:07:22 user nova-compute[75293]:   <devices>
Nov 30 07:07:22 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:07:22 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:07:22 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk"/>
Nov 30 07:07:22 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:07:22 user nova-compute[75293]:     </disk>
Nov 30 07:07:22 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:07:22 user nova-compute[75293]:       <mac address="fa:16:3e:70:14:32"/>
Nov 30 07:07:22 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:07:22 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:07:22 user nova-compute[75293]:       <target dev="tap60fdc1a9-86"/>
Nov 30 07:07:22 user nova-compute[75293]:     </interface>
Nov 30 07:07:22 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:07:22 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/console.log" append="off"/>
Nov 30 07:07:22 user nova-compute[75293]:     </serial>
Nov 30 07:07:22 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:07:22 user nova-compute[75293]:     <video>
Nov 30 07:07:22 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:07:22 user nova-compute[75293]:     </video>
Nov 30 07:07:22 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:07:22 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:07:22 user nova-compute[75293]:     </rng>
Nov 30 07:07:22 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:07:22 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:07:22 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:07:22 user nova-compute[75293]:     </memballoon>
Nov 30 07:07:22 user nova-compute[75293]:   </devices>
Nov 30 07:07:22 user nova-compute[75293]: </domain>
Nov 30 07:07:22 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1302031079',display_name='tempest-TestVolumeSwap-server-1302031079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1302031079',id=5,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEzAcOrRtFHkoAWbWt7bFOGLuIJulXu3F2Rz6BqNzmgRnIqDla3n+ON4yPeNFaHU726QsCAmpkKL0hIZihRliyV4fmnhMaE0VqV2GeKMLAZCdr/4eXXrC4GjDu04gyfaQ==',key_name='tempest-keypair-1061253891',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a232105c95a42669fd04b62416ded2f',ramdisk_id='',reservation_id='r-aohjr03f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1605433774',owner_user_name='tempest-TestVolumeSwap-1605433774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:07:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f2845232e8441c482acdb2c5f63c389',uuid=dcd1ca28-3784-45b3-a3d3-e3231d8e82bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "address": "fa:16:3e:70:14:32", "network": {"id": "874f6f69-e233-46c8-b3a1-1e056bb291f2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1191377101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a232105c95a42669fd04b62416ded2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fdc1a9-86", "ovs_interfaceid": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Converting VIF {"id": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "address": "fa:16:3e:70:14:32", "network": {"id": "874f6f69-e233-46c8-b3a1-1e056bb291f2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1191377101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a232105c95a42669fd04b62416ded2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fdc1a9-86", "ovs_interfaceid": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:14:32,bridge_name='br-int',has_traffic_filtering=True,id=60fdc1a9-8616-40a3-9380-b675ff1b3239,network=Network(874f6f69-e233-46c8-b3a1-1e056bb291f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60fdc1a9-86') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG os_vif [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:14:32,bridge_name='br-int',has_traffic_filtering=True,id=60fdc1a9-8616-40a3-9380-b675ff1b3239,network=Network(874f6f69-e233-46c8-b3a1-1e056bb291f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60fdc1a9-86') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.network.neutron [req-b5ada992-3d6b-4548-9454-f133fb39d487 req-2445d9ec-c205-4fd0-a224-96bfda91f3b6 service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Updated VIF entry in instance network info cache for port 693d3de2-b91f-4efb-9e5e-2281d858ec0b. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.network.neutron [req-b5ada992-3d6b-4548-9454-f133fb39d487 req-2445d9ec-c205-4fd0-a224-96bfda91f3b6 service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Updating instance_info_cache with network_info: [{"id": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "address": "fa:16:3e:0a:7f:0a", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693d3de2-b9", "ovs_interfaceid": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03fa0e28-1cb4-5fad-b168-bb5ca7348f18', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b5ada992-3d6b-4548-9454-f133fb39d487 req-2445d9ec-c205-4fd0-a224-96bfda91f3b6 service nova] Releasing lock "refresh_cache-061832ab-930a-470b-8b4f-dfc8f19fea6b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60fdc1a9-86, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60fdc1a9-86, col_values=(('qos', UUID('38333934-e56a-4699-8e69-96673e28576e')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60fdc1a9-86, col_values=(('external_ids', {'iface-id': '60fdc1a9-8616-40a3-9380-b675ff1b3239', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:14:32', 'vm-uuid': 'dcd1ca28-3784-45b3-a3d3-e3231d8e82bb'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:22 user nova-compute[75293]: INFO os_vif [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:14:32,bridge_name='br-int',has_traffic_filtering=True,id=60fdc1a9-8616-40a3-9380-b675ff1b3239,network=Network(874f6f69-e233-46c8-b3a1-1e056bb291f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60fdc1a9-86')
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] No VIF found with MAC fa:16:3e:70:14:32, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.compute.manager [req-6ac78aa2-92d1-479a-ab18-8bcb736d186a req-90d65eae-90f8-489d-b7d4-ae6e0c6ceca7 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6ac78aa2-92d1-479a-ab18-8bcb736d186a req-90d65eae-90f8-489d-b7d4-ae6e0c6ceca7 service nova] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6ac78aa2-92d1-479a-ab18-8bcb736d186a req-90d65eae-90f8-489d-b7d4-ae6e0c6ceca7 service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6ac78aa2-92d1-479a-ab18-8bcb736d186a req-90d65eae-90f8-489d-b7d4-ae6e0c6ceca7 service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:22 user nova-compute[75293]: DEBUG nova.compute.manager [req-6ac78aa2-92d1-479a-ab18-8bcb736d186a req-90d65eae-90f8-489d-b7d4-ae6e0c6ceca7 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] No waiting events found dispatching network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:07:22 user nova-compute[75293]: WARNING nova.compute.manager [req-6ac78aa2-92d1-479a-ab18-8bcb736d186a req-90d65eae-90f8-489d-b7d4-ae6e0c6ceca7 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received unexpected event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d for instance with vm_state active and task_state None.
Nov 30 07:07:23 user nova-compute[75293]: DEBUG nova.network.neutron [req-26cb533f-5e88-4ba4-989c-298232e45406 req-dbb8aa6b-c0e4-468b-a3b4-4f2f0659f355 service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Updated VIF entry in instance network info cache for port 60fdc1a9-8616-40a3-9380-b675ff1b3239. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:07:23 user nova-compute[75293]: DEBUG nova.network.neutron [req-26cb533f-5e88-4ba4-989c-298232e45406 req-dbb8aa6b-c0e4-468b-a3b4-4f2f0659f355 service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Updating instance_info_cache with network_info: [{"id": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "address": "fa:16:3e:70:14:32", "network": {"id": "874f6f69-e233-46c8-b3a1-1e056bb291f2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1191377101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a232105c95a42669fd04b62416ded2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fdc1a9-86", "ovs_interfaceid": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:07:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-26cb533f-5e88-4ba4-989c-298232e45406 req-dbb8aa6b-c0e4-468b-a3b4-4f2f0659f355 service nova] Releasing lock "refresh_cache-dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:07:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquiring lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:23 user nova-compute[75293]: DEBUG nova.compute.manager [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:07:24 user nova-compute[75293]: INFO nova.compute.claims [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Claim successful on node user
Nov 30 07:07:24 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.621s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG nova.compute.manager [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG nova.compute.manager [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG nova.network.neutron [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:07:24 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:07:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-370ebb56-6b82-45bb-b923-4c17bc7be889 req-45fe82e9-012c-4d4e-86cf-1afffac64c1b service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-370ebb56-6b82-45bb-b923-4c17bc7be889 req-45fe82e9-012c-4d4e-86cf-1afffac64c1b service nova] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-370ebb56-6b82-45bb-b923-4c17bc7be889 req-45fe82e9-012c-4d4e-86cf-1afffac64c1b service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-370ebb56-6b82-45bb-b923-4c17bc7be889 req-45fe82e9-012c-4d4e-86cf-1afffac64c1b service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-370ebb56-6b82-45bb-b923-4c17bc7be889 req-45fe82e9-012c-4d4e-86cf-1afffac64c1b service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] No waiting events found dispatching network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:07:24 user nova-compute[75293]: WARNING nova.compute.manager [req-370ebb56-6b82-45bb-b923-4c17bc7be889 req-45fe82e9-012c-4d4e-86cf-1afffac64c1b service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received unexpected event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d for instance with vm_state active and task_state None.
Nov 30 07:07:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-370ebb56-6b82-45bb-b923-4c17bc7be889 req-45fe82e9-012c-4d4e-86cf-1afffac64c1b service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received event network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-370ebb56-6b82-45bb-b923-4c17bc7be889 req-45fe82e9-012c-4d4e-86cf-1afffac64c1b service nova] Acquiring lock "251604ac-b300-49ae-ae1a-4543665fead6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-370ebb56-6b82-45bb-b923-4c17bc7be889 req-45fe82e9-012c-4d4e-86cf-1afffac64c1b service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-370ebb56-6b82-45bb-b923-4c17bc7be889 req-45fe82e9-012c-4d4e-86cf-1afffac64c1b service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-370ebb56-6b82-45bb-b923-4c17bc7be889 req-45fe82e9-012c-4d4e-86cf-1afffac64c1b service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] No waiting events found dispatching network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:07:24 user nova-compute[75293]: WARNING nova.compute.manager [req-370ebb56-6b82-45bb-b923-4c17bc7be889 req-45fe82e9-012c-4d4e-86cf-1afffac64c1b service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received unexpected event network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe for instance with vm_state active and task_state None.
Nov 30 07:07:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-370ebb56-6b82-45bb-b923-4c17bc7be889 req-45fe82e9-012c-4d4e-86cf-1afffac64c1b service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received event network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-370ebb56-6b82-45bb-b923-4c17bc7be889 req-45fe82e9-012c-4d4e-86cf-1afffac64c1b service nova] Acquiring lock "251604ac-b300-49ae-ae1a-4543665fead6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-370ebb56-6b82-45bb-b923-4c17bc7be889 req-45fe82e9-012c-4d4e-86cf-1afffac64c1b service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-370ebb56-6b82-45bb-b923-4c17bc7be889 req-45fe82e9-012c-4d4e-86cf-1afffac64c1b service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-370ebb56-6b82-45bb-b923-4c17bc7be889 req-45fe82e9-012c-4d4e-86cf-1afffac64c1b service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] No waiting events found dispatching network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:07:24 user nova-compute[75293]: WARNING nova.compute.manager [req-370ebb56-6b82-45bb-b923-4c17bc7be889 req-45fe82e9-012c-4d4e-86cf-1afffac64c1b service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received unexpected event network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe for instance with vm_state active and task_state None.
Nov 30 07:07:24 user nova-compute[75293]: DEBUG nova.compute.manager [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG nova.policy [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3af22daef9746c99424bf6581cc7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67436111c10f475a9e2d249fe77f04c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG nova.compute.manager [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:07:25 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Creating image(s)
Nov 30 07:07:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquiring lock "/opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "/opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "/opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.218s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.198s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk 1073741824" returned: 0 in 0.060s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Acquiring lock "4ca1e46c-e83f-4476-a225-79e83151e222" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Lock "4ca1e46c-e83f-4476-a225-79e83151e222" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG nova.compute.manager [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG nova.network.neutron [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Successfully created port: 4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.274s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:07:25 user nova-compute[75293]: INFO nova.compute.claims [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Claim successful on node user
Nov 30 07:07:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Cannot resize image /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Ensure instance console log exists: /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG nova.compute.manager [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG nova.compute.manager [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG nova.network.neutron [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:07:26 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:07:26 user nova-compute[75293]: DEBUG nova.network.neutron [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Successfully updated port: 4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG nova.compute.manager [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquiring lock "refresh_cache-67b8a66b-e7f8-41a1-8f5c-b29851ec608d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquired lock "refresh_cache-67b8a66b-e7f8-41a1-8f5c-b29851ec608d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG nova.network.neutron [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG nova.policy [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2def2c5e09d34daba7b1999f2ca2a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546752562a4b4dd8b72b8b5a50b94edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-0aab15da-f1c5-4722-9fab-fe7ab331e3c8 req-331a349f-ada1-4f7d-ac95-368e38159f20 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received event network-changed-4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-0aab15da-f1c5-4722-9fab-fe7ab331e3c8 req-331a349f-ada1-4f7d-ac95-368e38159f20 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Refreshing instance network info cache due to event network-changed-4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0aab15da-f1c5-4722-9fab-fe7ab331e3c8 req-331a349f-ada1-4f7d-ac95-368e38159f20 service nova] Acquiring lock "refresh_cache-67b8a66b-e7f8-41a1-8f5c-b29851ec608d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG nova.network.neutron [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG nova.compute.manager [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:07:26 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Creating image(s)
Nov 30 07:07:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Lock "/opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Lock "/opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.208s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.network.neutron [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Updating instance_info_cache with network_info: [{"id": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "address": "fa:16:3e:2b:05:2c", "network": {"id": "ebc5494d-4e41-410c-a9ef-96a92a44d1d2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1004206243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4079c1bd-9b", "ovs_interfaceid": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Releasing lock "refresh_cache-67b8a66b-e7f8-41a1-8f5c-b29851ec608d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Instance network_info: |[{"id": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "address": "fa:16:3e:2b:05:2c", "network": {"id": "ebc5494d-4e41-410c-a9ef-96a92a44d1d2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1004206243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4079c1bd-9b", "ovs_interfaceid": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0aab15da-f1c5-4722-9fab-fe7ab331e3c8 req-331a349f-ada1-4f7d-ac95-368e38159f20 service nova] Acquired lock "refresh_cache-67b8a66b-e7f8-41a1-8f5c-b29851ec608d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.network.neutron [req-0aab15da-f1c5-4722-9fab-fe7ab331e3c8 req-331a349f-ada1-4f7d-ac95-368e38159f20 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Refreshing network info cache for port 4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Start _get_guest_xml network_info=[{"id": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "address": "fa:16:3e:2b:05:2c", "network": {"id": "ebc5494d-4e41-410c-a9ef-96a92a44d1d2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1004206243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4079c1bd-9b", "ovs_interfaceid": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:07:27 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:27 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-448272992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-448272992',id=7,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjlAvbNSNxOu5edth1vYgsFbUXzkyrWPcRf1ffRD5CrTsh6WZzOo54MVbNVFLS5n8k7/BjeCIsOHkQu7rwF07QgVmeG30dScHl8rc2yZM/6i1oYAPea7ho5miPIPyzMag==',key_name='tempest-keypair-2066695250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67436111c10f475a9e2d249fe77f04c9',ramdisk_id='',reservation_id='r-p1eo2eq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-825521733',owner_user_name='tempest-TaggedAttachmentsTest-825521733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:07:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3af22daef9746c99424bf6581cc7608',uuid=67b8a66b-e7f8-41a1-8f5c-b29851ec608d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "address": "fa:16:3e:2b:05:2c", "network": {"id": "ebc5494d-4e41-410c-a9ef-96a92a44d1d2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1004206243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4079c1bd-9b", "ovs_interfaceid": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Converting VIF {"id": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "address": "fa:16:3e:2b:05:2c", "network": {"id": "ebc5494d-4e41-410c-a9ef-96a92a44d1d2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1004206243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4079c1bd-9b", "ovs_interfaceid": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:05:2c,bridge_name='br-int',has_traffic_filtering=True,id=4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e,network=Network(ebc5494d-4e41-410c-a9ef-96a92a44d1d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4079c1bd-9b') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.objects.instance [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lazy-loading 'pci_devices' on Instance uuid 67b8a66b-e7f8-41a1-8f5c-b29851ec608d {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.251s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:07:27 user nova-compute[75293]:   <uuid>67b8a66b-e7f8-41a1-8f5c-b29851ec608d</uuid>
Nov 30 07:07:27 user nova-compute[75293]:   <name>instance-00000007</name>
Nov 30 07:07:27 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:07:27 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:07:27 user nova-compute[75293]:   <metadata>
Nov 30 07:07:27 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:07:27 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:07:27 user nova-compute[75293]:       <nova:name>tempest-device-tagging-server-448272992</nova:name>
Nov 30 07:07:27 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:07:27</nova:creationTime>
Nov 30 07:07:27 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:07:27 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:07:27 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:07:27 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:07:27 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:07:27 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:07:27 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:07:27 user nova-compute[75293]:       <nova:owner>
Nov 30 07:07:27 user nova-compute[75293]:         <nova:user uuid="d3af22daef9746c99424bf6581cc7608">tempest-TaggedAttachmentsTest-825521733-project-member</nova:user>
Nov 30 07:07:27 user nova-compute[75293]:         <nova:project uuid="67436111c10f475a9e2d249fe77f04c9">tempest-TaggedAttachmentsTest-825521733</nova:project>
Nov 30 07:07:27 user nova-compute[75293]:       </nova:owner>
Nov 30 07:07:27 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:07:27 user nova-compute[75293]:       <nova:ports>
Nov 30 07:07:27 user nova-compute[75293]:         <nova:port uuid="4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e">
Nov 30 07:07:27 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 07:07:27 user nova-compute[75293]:         </nova:port>
Nov 30 07:07:27 user nova-compute[75293]:       </nova:ports>
Nov 30 07:07:27 user nova-compute[75293]:     </nova:instance>
Nov 30 07:07:27 user nova-compute[75293]:   </metadata>
Nov 30 07:07:27 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:07:27 user nova-compute[75293]:     <system>
Nov 30 07:07:27 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:07:27 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:07:27 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:07:27 user nova-compute[75293]:       <entry name="serial">67b8a66b-e7f8-41a1-8f5c-b29851ec608d</entry>
Nov 30 07:07:27 user nova-compute[75293]:       <entry name="uuid">67b8a66b-e7f8-41a1-8f5c-b29851ec608d</entry>
Nov 30 07:07:27 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:07:27 user nova-compute[75293]:     </system>
Nov 30 07:07:27 user nova-compute[75293]:   </sysinfo>
Nov 30 07:07:27 user nova-compute[75293]:   <os>
Nov 30 07:07:27 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:07:27 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:07:27 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:07:27 user nova-compute[75293]:   </os>
Nov 30 07:07:27 user nova-compute[75293]:   <features>
Nov 30 07:07:27 user nova-compute[75293]:     <acpi/>
Nov 30 07:07:27 user nova-compute[75293]:     <apic/>
Nov 30 07:07:27 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:07:27 user nova-compute[75293]:   </features>
Nov 30 07:07:27 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:07:27 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:07:27 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:07:27 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:07:27 user nova-compute[75293]:   </clock>
Nov 30 07:07:27 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:07:27 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:07:27 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:07:27 user nova-compute[75293]:   </cpu>
Nov 30 07:07:27 user nova-compute[75293]:   <devices>
Nov 30 07:07:27 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:07:27 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:07:27 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk"/>
Nov 30 07:07:27 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:07:27 user nova-compute[75293]:     </disk>
Nov 30 07:07:27 user nova-compute[75293]:     <disk type="file" device="cdrom">
Nov 30 07:07:27 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none"/>
Nov 30 07:07:27 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk.config"/>
Nov 30 07:07:27 user nova-compute[75293]:       <target dev="hda" bus="ide"/>
Nov 30 07:07:27 user nova-compute[75293]:     </disk>
Nov 30 07:07:27 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:07:27 user nova-compute[75293]:       <mac address="fa:16:3e:2b:05:2c"/>
Nov 30 07:07:27 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:07:27 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:07:27 user nova-compute[75293]:       <target dev="tap4079c1bd-9b"/>
Nov 30 07:07:27 user nova-compute[75293]:     </interface>
Nov 30 07:07:27 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:07:27 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/console.log" append="off"/>
Nov 30 07:07:27 user nova-compute[75293]:     </serial>
Nov 30 07:07:27 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:07:27 user nova-compute[75293]:     <video>
Nov 30 07:07:27 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:07:27 user nova-compute[75293]:     </video>
Nov 30 07:07:27 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:07:27 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:07:27 user nova-compute[75293]:     </rng>
Nov 30 07:07:27 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:07:27 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:07:27 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:07:27 user nova-compute[75293]:     </memballoon>
Nov 30 07:07:27 user nova-compute[75293]:   </devices>
Nov 30 07:07:27 user nova-compute[75293]: </domain>
Nov 30 07:07:27 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-448272992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-448272992',id=7,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjlAvbNSNxOu5edth1vYgsFbUXzkyrWPcRf1ffRD5CrTsh6WZzOo54MVbNVFLS5n8k7/BjeCIsOHkQu7rwF07QgVmeG30dScHl8rc2yZM/6i1oYAPea7ho5miPIPyzMag==',key_name='tempest-keypair-2066695250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67436111c10f475a9e2d249fe77f04c9',ramdisk_id='',reservation_id='r-p1eo2eq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-825521733',owner_user_name='tempest-TaggedAttachmentsTest-825521733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:07:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3af22daef9746c99424bf6581cc7608',uuid=67b8a66b-e7f8-41a1-8f5c-b29851ec608d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "address": "fa:16:3e:2b:05:2c", "network": {"id": "ebc5494d-4e41-410c-a9ef-96a92a44d1d2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1004206243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4079c1bd-9b", "ovs_interfaceid": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Converting VIF {"id": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "address": "fa:16:3e:2b:05:2c", "network": {"id": "ebc5494d-4e41-410c-a9ef-96a92a44d1d2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1004206243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4079c1bd-9b", "ovs_interfaceid": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:05:2c,bridge_name='br-int',has_traffic_filtering=True,id=4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e,network=Network(ebc5494d-4e41-410c-a9ef-96a92a44d1d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4079c1bd-9b') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG os_vif [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:05:2c,bridge_name='br-int',has_traffic_filtering=True,id=4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e,network=Network(ebc5494d-4e41-410c-a9ef-96a92a44d1d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4079c1bd-9b') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.network.neutron [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Successfully created port: 0a97402b-7eac-4b1f-9697-19a03235d6ec {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3ebcf06-6e71-5012-8aed-5d297b51167e', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/disk 1073741824" returned: 0 in 0.112s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.369s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4079c1bd-9b, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4079c1bd-9b, col_values=(('qos', UUID('4e99b068-2077-467f-94d8-5e50519081b0')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4079c1bd-9b, col_values=(('external_ids', {'iface-id': '4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:05:2c', 'vm-uuid': '67b8a66b-e7f8-41a1-8f5c-b29851ec608d'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:27 user nova-compute[75293]: INFO os_vif [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:05:2c,bridge_name='br-int',has_traffic_filtering=True,id=4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e,network=Network(ebc5494d-4e41-410c-a9ef-96a92a44d1d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4079c1bd-9b')
Nov 30 07:07:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.187s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] No BDM found with device name hda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:07:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] No VIF found with MAC fa:16:3e:2b:05:2c, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:07:27 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Using config drive
Nov 30 07:07:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Cannot resize image /opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Ensure instance console log exists: /opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:28 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Creating config drive at /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk.config
Nov 30 07:07:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpljrsyble {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG nova.network.neutron [req-0aab15da-f1c5-4722-9fab-fe7ab331e3c8 req-331a349f-ada1-4f7d-ac95-368e38159f20 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Updated VIF entry in instance network info cache for port 4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG nova.network.neutron [req-0aab15da-f1c5-4722-9fab-fe7ab331e3c8 req-331a349f-ada1-4f7d-ac95-368e38159f20 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Updating instance_info_cache with network_info: [{"id": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "address": "fa:16:3e:2b:05:2c", "network": {"id": "ebc5494d-4e41-410c-a9ef-96a92a44d1d2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1004206243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4079c1bd-9b", "ovs_interfaceid": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpljrsyble" returned: 0 in 0.104s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0aab15da-f1c5-4722-9fab-fe7ab331e3c8 req-331a349f-ada1-4f7d-ac95-368e38159f20 service nova] Releasing lock "refresh_cache-67b8a66b-e7f8-41a1-8f5c-b29851ec608d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG nova.network.neutron [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Successfully updated port: 0a97402b-7eac-4b1f-9697-19a03235d6ec {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Acquiring lock "refresh_cache-4ca1e46c-e83f-4476-a225-79e83151e222" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Acquired lock "refresh_cache-4ca1e46c-e83f-4476-a225-79e83151e222" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG nova.network.neutron [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG nova.compute.manager [req-792f28b0-a072-4b65-82ca-d0c551a7b4b7 req-0a158254-7fb1-44c8-a5db-767176cf0905 service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Received event network-changed-0a97402b-7eac-4b1f-9697-19a03235d6ec {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG nova.compute.manager [req-792f28b0-a072-4b65-82ca-d0c551a7b4b7 req-0a158254-7fb1-44c8-a5db-767176cf0905 service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Refreshing instance network info cache due to event network-changed-0a97402b-7eac-4b1f-9697-19a03235d6ec. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-792f28b0-a072-4b65-82ca-d0c551a7b4b7 req-0a158254-7fb1-44c8-a5db-767176cf0905 service nova] Acquiring lock "refresh_cache-4ca1e46c-e83f-4476-a225-79e83151e222" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG nova.network.neutron [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG nova.network.neutron [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Updating instance_info_cache with network_info: [{"id": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "address": "fa:16:3e:5e:78:b6", "network": {"id": "7dd319d3-1085-4cd1-a711-d807a563714b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-616822404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546752562a4b4dd8b72b8b5a50b94edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a97402b-7e", "ovs_interfaceid": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Releasing lock "refresh_cache-4ca1e46c-e83f-4476-a225-79e83151e222" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG nova.compute.manager [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Instance network_info: |[{"id": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "address": "fa:16:3e:5e:78:b6", "network": {"id": "7dd319d3-1085-4cd1-a711-d807a563714b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-616822404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546752562a4b4dd8b72b8b5a50b94edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a97402b-7e", "ovs_interfaceid": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-792f28b0-a072-4b65-82ca-d0c551a7b4b7 req-0a158254-7fb1-44c8-a5db-767176cf0905 service nova] Acquired lock "refresh_cache-4ca1e46c-e83f-4476-a225-79e83151e222" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG nova.network.neutron [req-792f28b0-a072-4b65-82ca-d0c551a7b4b7 req-0a158254-7fb1-44c8-a5db-767176cf0905 service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Refreshing network info cache for port 0a97402b-7eac-4b1f-9697-19a03235d6ec {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:07:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Start _get_guest_xml network_info=[{"id": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "address": "fa:16:3e:5e:78:b6", "network": {"id": "7dd319d3-1085-4cd1-a711-d807a563714b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-616822404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546752562a4b4dd8b72b8b5a50b94edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a97402b-7e", "ovs_interfaceid": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:07:28 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:28 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1290098302',display_name='tempest-VolumesActionsTest-instance-1290098302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1290098302',id=8,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='546752562a4b4dd8b72b8b5a50b94edf',ramdisk_id='',reservation_id='r-rdsb7bov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-268994549',owner_user_name='tempest-VolumesActionsTest-268994549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:07:27Z,user_data=None,user_id='2def2c5e09d34daba7b1999f2ca2a2b2',uuid=4ca1e46c-e83f-4476-a225-79e83151e222,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "address": "fa:16:3e:5e:78:b6", "network": {"id": "7dd319d3-1085-4cd1-a711-d807a563714b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-616822404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546752562a4b4dd8b72b8b5a50b94edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a97402b-7e", "ovs_interfaceid": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Converting VIF {"id": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "address": "fa:16:3e:5e:78:b6", "network": {"id": "7dd319d3-1085-4cd1-a711-d807a563714b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-616822404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546752562a4b4dd8b72b8b5a50b94edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a97402b-7e", "ovs_interfaceid": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:78:b6,bridge_name='br-int',has_traffic_filtering=True,id=0a97402b-7eac-4b1f-9697-19a03235d6ec,network=Network(7dd319d3-1085-4cd1-a711-d807a563714b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a97402b-7e') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.objects.instance [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ca1e46c-e83f-4476-a225-79e83151e222 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:07:29 user nova-compute[75293]:   <uuid>4ca1e46c-e83f-4476-a225-79e83151e222</uuid>
Nov 30 07:07:29 user nova-compute[75293]:   <name>instance-00000008</name>
Nov 30 07:07:29 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:07:29 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:07:29 user nova-compute[75293]:   <metadata>
Nov 30 07:07:29 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:07:29 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:07:29 user nova-compute[75293]:       <nova:name>tempest-VolumesActionsTest-instance-1290098302</nova:name>
Nov 30 07:07:29 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:07:28</nova:creationTime>
Nov 30 07:07:29 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:07:29 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:07:29 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:07:29 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:07:29 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:07:29 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:07:29 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:07:29 user nova-compute[75293]:       <nova:owner>
Nov 30 07:07:29 user nova-compute[75293]:         <nova:user uuid="2def2c5e09d34daba7b1999f2ca2a2b2">tempest-VolumesActionsTest-268994549-project-member</nova:user>
Nov 30 07:07:29 user nova-compute[75293]:         <nova:project uuid="546752562a4b4dd8b72b8b5a50b94edf">tempest-VolumesActionsTest-268994549</nova:project>
Nov 30 07:07:29 user nova-compute[75293]:       </nova:owner>
Nov 30 07:07:29 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:07:29 user nova-compute[75293]:       <nova:ports>
Nov 30 07:07:29 user nova-compute[75293]:         <nova:port uuid="0a97402b-7eac-4b1f-9697-19a03235d6ec">
Nov 30 07:07:29 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 07:07:29 user nova-compute[75293]:         </nova:port>
Nov 30 07:07:29 user nova-compute[75293]:       </nova:ports>
Nov 30 07:07:29 user nova-compute[75293]:     </nova:instance>
Nov 30 07:07:29 user nova-compute[75293]:   </metadata>
Nov 30 07:07:29 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:07:29 user nova-compute[75293]:     <system>
Nov 30 07:07:29 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:07:29 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:07:29 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:07:29 user nova-compute[75293]:       <entry name="serial">4ca1e46c-e83f-4476-a225-79e83151e222</entry>
Nov 30 07:07:29 user nova-compute[75293]:       <entry name="uuid">4ca1e46c-e83f-4476-a225-79e83151e222</entry>
Nov 30 07:07:29 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:07:29 user nova-compute[75293]:     </system>
Nov 30 07:07:29 user nova-compute[75293]:   </sysinfo>
Nov 30 07:07:29 user nova-compute[75293]:   <os>
Nov 30 07:07:29 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:07:29 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:07:29 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:07:29 user nova-compute[75293]:   </os>
Nov 30 07:07:29 user nova-compute[75293]:   <features>
Nov 30 07:07:29 user nova-compute[75293]:     <acpi/>
Nov 30 07:07:29 user nova-compute[75293]:     <apic/>
Nov 30 07:07:29 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:07:29 user nova-compute[75293]:   </features>
Nov 30 07:07:29 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:07:29 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:07:29 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:07:29 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:07:29 user nova-compute[75293]:   </clock>
Nov 30 07:07:29 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:07:29 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:07:29 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:07:29 user nova-compute[75293]:   </cpu>
Nov 30 07:07:29 user nova-compute[75293]:   <devices>
Nov 30 07:07:29 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:07:29 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:07:29 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/disk"/>
Nov 30 07:07:29 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:07:29 user nova-compute[75293]:     </disk>
Nov 30 07:07:29 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:07:29 user nova-compute[75293]:       <mac address="fa:16:3e:5e:78:b6"/>
Nov 30 07:07:29 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:07:29 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:07:29 user nova-compute[75293]:       <target dev="tap0a97402b-7e"/>
Nov 30 07:07:29 user nova-compute[75293]:     </interface>
Nov 30 07:07:29 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:07:29 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/console.log" append="off"/>
Nov 30 07:07:29 user nova-compute[75293]:     </serial>
Nov 30 07:07:29 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:07:29 user nova-compute[75293]:     <video>
Nov 30 07:07:29 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:07:29 user nova-compute[75293]:     </video>
Nov 30 07:07:29 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:07:29 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:07:29 user nova-compute[75293]:     </rng>
Nov 30 07:07:29 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:07:29 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:07:29 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:07:29 user nova-compute[75293]:     </memballoon>
Nov 30 07:07:29 user nova-compute[75293]:   </devices>
Nov 30 07:07:29 user nova-compute[75293]: </domain>
Nov 30 07:07:29 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1290098302',display_name='tempest-VolumesActionsTest-instance-1290098302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1290098302',id=8,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='546752562a4b4dd8b72b8b5a50b94edf',ramdisk_id='',reservation_id='r-rdsb7bov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-268994549',owner_user_name='tempest-VolumesActionsTest-268994549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:07:27Z,user_data=None,user_id='2def2c5e09d34daba7b1999f2ca2a2b2',uuid=4ca1e46c-e83f-4476-a225-79e83151e222,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "address": "fa:16:3e:5e:78:b6", "network": {"id": "7dd319d3-1085-4cd1-a711-d807a563714b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-616822404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546752562a4b4dd8b72b8b5a50b94edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a97402b-7e", "ovs_interfaceid": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Converting VIF {"id": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "address": "fa:16:3e:5e:78:b6", "network": {"id": "7dd319d3-1085-4cd1-a711-d807a563714b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-616822404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546752562a4b4dd8b72b8b5a50b94edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a97402b-7e", "ovs_interfaceid": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:78:b6,bridge_name='br-int',has_traffic_filtering=True,id=0a97402b-7eac-4b1f-9697-19a03235d6ec,network=Network(7dd319d3-1085-4cd1-a711-d807a563714b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a97402b-7e') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG os_vif [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:78:b6,bridge_name='br-int',has_traffic_filtering=True,id=0a97402b-7eac-4b1f-9697-19a03235d6ec,network=Network(7dd319d3-1085-4cd1-a711-d807a563714b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a97402b-7e') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0882099c-50b4-510a-9fef-69f957125ce2', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a97402b-7e, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a97402b-7e, col_values=(('qos', UUID('27774166-39d7-4c73-aa39-f3721fb547e6')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a97402b-7e, col_values=(('external_ids', {'iface-id': '0a97402b-7eac-4b1f-9697-19a03235d6ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:78:b6', 'vm-uuid': '4ca1e46c-e83f-4476-a225-79e83151e222'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:29 user nova-compute[75293]: INFO os_vif [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:78:b6,bridge_name='br-int',has_traffic_filtering=True,id=0a97402b-7eac-4b1f-9697-19a03235d6ec,network=Network(7dd319d3-1085-4cd1-a711-d807a563714b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a97402b-7e')
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] No VIF found with MAC fa:16:3e:5e:78:b6, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.network.neutron [req-792f28b0-a072-4b65-82ca-d0c551a7b4b7 req-0a158254-7fb1-44c8-a5db-767176cf0905 service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Updated VIF entry in instance network info cache for port 0a97402b-7eac-4b1f-9697-19a03235d6ec. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG nova.network.neutron [req-792f28b0-a072-4b65-82ca-d0c551a7b4b7 req-0a158254-7fb1-44c8-a5db-767176cf0905 service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Updating instance_info_cache with network_info: [{"id": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "address": "fa:16:3e:5e:78:b6", "network": {"id": "7dd319d3-1085-4cd1-a711-d807a563714b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-616822404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546752562a4b4dd8b72b8b5a50b94edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a97402b-7e", "ovs_interfaceid": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:07:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-792f28b0-a072-4b65-82ca-d0c551a7b4b7 req-0a158254-7fb1-44c8-a5db-767176cf0905 service nova] Releasing lock "refresh_cache-4ca1e46c-e83f-4476-a225-79e83151e222" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:07:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:30 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:07:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:07:30 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Instance spawned successfully.
Nov 30 07:07:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:07:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-f260e2cc-7963-4ff5-8854-ca42dba7250a req-0ffa9012-0f85-4f22-b070-dab2f4226734 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received event network-vif-plugged-4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f260e2cc-7963-4ff5-8854-ca42dba7250a req-0ffa9012-0f85-4f22-b070-dab2f4226734 service nova] Acquiring lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f260e2cc-7963-4ff5-8854-ca42dba7250a req-0ffa9012-0f85-4f22-b070-dab2f4226734 service nova] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f260e2cc-7963-4ff5-8854-ca42dba7250a req-0ffa9012-0f85-4f22-b070-dab2f4226734 service nova] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-f260e2cc-7963-4ff5-8854-ca42dba7250a req-0ffa9012-0f85-4f22-b070-dab2f4226734 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] No waiting events found dispatching network-vif-plugged-4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:07:30 user nova-compute[75293]: WARNING nova.compute.manager [req-f260e2cc-7963-4ff5-8854-ca42dba7250a req-0ffa9012-0f85-4f22-b070-dab2f4226734 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received unexpected event network-vif-plugged-4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e for instance with vm_state building and task_state spawning.
Nov 30 07:07:30 user nova-compute[75293]: INFO nova.compute.manager [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Took 13.18 seconds to spawn the instance on the hypervisor.
Nov 30 07:07:30 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:07:31 user nova-compute[75293]: INFO nova.compute.manager [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Took 14.55 seconds to build instance.
Nov 30 07:07:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4874fdf-262e-4da8-b745-f07fe24c521d tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.843s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:31 user nova-compute[75293]: DEBUG nova.compute.manager [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:07:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:07:31 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Instance spawned successfully.
Nov 30 07:07:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:07:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:31 user nova-compute[75293]: DEBUG nova.compute.manager [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:07:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:07:31 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Instance spawned successfully.
Nov 30 07:07:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:07:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:32 user nova-compute[75293]: INFO nova.compute.manager [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Took 18.59 seconds to spawn the instance on the hypervisor.
Nov 30 07:07:32 user nova-compute[75293]: DEBUG nova.compute.manager [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:07:32 user nova-compute[75293]: INFO nova.compute.manager [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Took 15.97 seconds to spawn the instance on the hypervisor.
Nov 30 07:07:32 user nova-compute[75293]: DEBUG nova.compute.manager [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:07:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:32 user nova-compute[75293]: INFO nova.compute.manager [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Took 19.86 seconds to build instance.
Nov 30 07:07:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-daa89f11-7353-4746-981d-49d21b69fd19 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.010s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:32 user nova-compute[75293]: INFO nova.compute.manager [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Took 17.79 seconds to build instance.
Nov 30 07:07:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-2cc230bc-98dd-4f28-8895-ff59b75946b5 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.967s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Acquiring lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:32 user nova-compute[75293]: DEBUG nova.compute.manager [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:07:33 user nova-compute[75293]: DEBUG nova.compute.manager [req-4fa6842a-97ac-4079-a621-d0c839a80933 req-b303b3f1-20aa-4f49-b5f0-77e4d7ba106d service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received event network-vif-plugged-4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4fa6842a-97ac-4079-a621-d0c839a80933 req-b303b3f1-20aa-4f49-b5f0-77e4d7ba106d service nova] Acquiring lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4fa6842a-97ac-4079-a621-d0c839a80933 req-b303b3f1-20aa-4f49-b5f0-77e4d7ba106d service nova] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4fa6842a-97ac-4079-a621-d0c839a80933 req-b303b3f1-20aa-4f49-b5f0-77e4d7ba106d service nova] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:33 user nova-compute[75293]: DEBUG nova.compute.manager [req-4fa6842a-97ac-4079-a621-d0c839a80933 req-b303b3f1-20aa-4f49-b5f0-77e4d7ba106d service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] No waiting events found dispatching network-vif-plugged-4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:07:33 user nova-compute[75293]: WARNING nova.compute.manager [req-4fa6842a-97ac-4079-a621-d0c839a80933 req-b303b3f1-20aa-4f49-b5f0-77e4d7ba106d service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received unexpected event network-vif-plugged-4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e for instance with vm_state building and task_state spawning.
Nov 30 07:07:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:07:33 user nova-compute[75293]: INFO nova.compute.claims [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Claim successful on node user
Nov 30 07:07:33 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:07:33 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:07:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:33 user nova-compute[75293]: DEBUG nova.compute.manager [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:07:34 user nova-compute[75293]: DEBUG nova.compute.manager [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:07:34 user nova-compute[75293]: DEBUG nova.network.neutron [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:07:34 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:07:34 user nova-compute[75293]: DEBUG nova.compute.manager [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:07:34 user nova-compute[75293]: DEBUG nova.policy [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61406119263a4a979ca668162d9e676a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda1342c66f8477a830d140c3791d1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:07:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:34 user nova-compute[75293]: DEBUG nova.compute.manager [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:07:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:07:34 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Creating image(s)
Nov 30 07:07:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Lock "/opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.008s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Lock "/opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.221s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.222s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk 1073741824" returned: 0 in 0.077s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.234s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.network.neutron [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Successfully created port: ca13e5bf-0c02-4a9d-b23f-079495c5a34f {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.compute.manager [req-4fa6cf4e-2482-4c13-961c-7573a1eb9164 req-0affd22b-0d48-4ac2-bb01-b3a2f41af6fb service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Received event network-vif-plugged-693d3de2-b91f-4efb-9e5e-2281d858ec0b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4fa6cf4e-2482-4c13-961c-7573a1eb9164 req-0affd22b-0d48-4ac2-bb01-b3a2f41af6fb service nova] Acquiring lock "061832ab-930a-470b-8b4f-dfc8f19fea6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4fa6cf4e-2482-4c13-961c-7573a1eb9164 req-0affd22b-0d48-4ac2-bb01-b3a2f41af6fb service nova] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4fa6cf4e-2482-4c13-961c-7573a1eb9164 req-0affd22b-0d48-4ac2-bb01-b3a2f41af6fb service nova] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.compute.manager [req-4fa6cf4e-2482-4c13-961c-7573a1eb9164 req-0affd22b-0d48-4ac2-bb01-b3a2f41af6fb service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] No waiting events found dispatching network-vif-plugged-693d3de2-b91f-4efb-9e5e-2281d858ec0b {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:07:35 user nova-compute[75293]: WARNING nova.compute.manager [req-4fa6cf4e-2482-4c13-961c-7573a1eb9164 req-0affd22b-0d48-4ac2-bb01-b3a2f41af6fb service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Received unexpected event network-vif-plugged-693d3de2-b91f-4efb-9e5e-2281d858ec0b for instance with vm_state active and task_state None.
Nov 30 07:07:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Cannot resize image /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Ensure instance console log exists: /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.compute.manager [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.compute.manager [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:07:35 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Instance spawned successfully.
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:07:35 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Instance spawned successfully.
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:35 user nova-compute[75293]: INFO nova.compute.manager [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Took 8.81 seconds to spawn the instance on the hypervisor.
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.compute.manager [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:07:35 user nova-compute[75293]: INFO nova.compute.manager [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Took 10.66 seconds to spawn the instance on the hypervisor.
Nov 30 07:07:35 user nova-compute[75293]: DEBUG nova.compute.manager [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:07:35 user nova-compute[75293]: INFO nova.compute.manager [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Took 11.81 seconds to build instance.
Nov 30 07:07:36 user nova-compute[75293]: INFO nova.compute.manager [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Took 10.14 seconds to build instance.
Nov 30 07:07:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-22a587de-35dd-4cbb-9b8f-27fce97acc19 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.070s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-69d0d680-d81e-4db2-a7c1-ed468ea9f1d1 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Lock "4ca1e46c-e83f-4476-a225-79e83151e222" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.358s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:36 user nova-compute[75293]: DEBUG nova.network.neutron [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Successfully updated port: ca13e5bf-0c02-4a9d-b23f-079495c5a34f {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:07:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Acquiring lock "refresh_cache-ca1e65f3-8696-4c9a-b4df-ce5923e1de31" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:07:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Acquired lock "refresh_cache-ca1e65f3-8696-4c9a-b4df-ce5923e1de31" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:07:36 user nova-compute[75293]: DEBUG nova.network.neutron [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:07:36 user nova-compute[75293]: DEBUG nova.compute.manager [req-5ff3d860-cc0a-4f53-8359-efcbe7f0e6eb req-3756a969-8ed9-45ee-954f-6507db71b2b4 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Received event network-changed-ca13e5bf-0c02-4a9d-b23f-079495c5a34f {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:36 user nova-compute[75293]: DEBUG nova.compute.manager [req-5ff3d860-cc0a-4f53-8359-efcbe7f0e6eb req-3756a969-8ed9-45ee-954f-6507db71b2b4 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Refreshing instance network info cache due to event network-changed-ca13e5bf-0c02-4a9d-b23f-079495c5a34f. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:07:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5ff3d860-cc0a-4f53-8359-efcbe7f0e6eb req-3756a969-8ed9-45ee-954f-6507db71b2b4 service nova] Acquiring lock "refresh_cache-ca1e65f3-8696-4c9a-b4df-ce5923e1de31" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.network.neutron [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.compute.manager [req-d1aa4502-4469-4100-9440-cd19e5b0cad2 req-6728c0a5-8a66-455e-8fc7-3e152b051fc2 service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Received event network-vif-plugged-693d3de2-b91f-4efb-9e5e-2281d858ec0b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d1aa4502-4469-4100-9440-cd19e5b0cad2 req-6728c0a5-8a66-455e-8fc7-3e152b051fc2 service nova] Acquiring lock "061832ab-930a-470b-8b4f-dfc8f19fea6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d1aa4502-4469-4100-9440-cd19e5b0cad2 req-6728c0a5-8a66-455e-8fc7-3e152b051fc2 service nova] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d1aa4502-4469-4100-9440-cd19e5b0cad2 req-6728c0a5-8a66-455e-8fc7-3e152b051fc2 service nova] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.compute.manager [req-d1aa4502-4469-4100-9440-cd19e5b0cad2 req-6728c0a5-8a66-455e-8fc7-3e152b051fc2 service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] No waiting events found dispatching network-vif-plugged-693d3de2-b91f-4efb-9e5e-2281d858ec0b {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:07:37 user nova-compute[75293]: WARNING nova.compute.manager [req-d1aa4502-4469-4100-9440-cd19e5b0cad2 req-6728c0a5-8a66-455e-8fc7-3e152b051fc2 service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Received unexpected event network-vif-plugged-693d3de2-b91f-4efb-9e5e-2281d858ec0b for instance with vm_state active and task_state None.
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.compute.manager [req-d1aa4502-4469-4100-9440-cd19e5b0cad2 req-6728c0a5-8a66-455e-8fc7-3e152b051fc2 service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Received event network-vif-plugged-53964f53-7286-4710-bc56-709f3d460ba2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d1aa4502-4469-4100-9440-cd19e5b0cad2 req-6728c0a5-8a66-455e-8fc7-3e152b051fc2 service nova] Acquiring lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d1aa4502-4469-4100-9440-cd19e5b0cad2 req-6728c0a5-8a66-455e-8fc7-3e152b051fc2 service nova] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d1aa4502-4469-4100-9440-cd19e5b0cad2 req-6728c0a5-8a66-455e-8fc7-3e152b051fc2 service nova] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.compute.manager [req-d1aa4502-4469-4100-9440-cd19e5b0cad2 req-6728c0a5-8a66-455e-8fc7-3e152b051fc2 service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] No waiting events found dispatching network-vif-plugged-53964f53-7286-4710-bc56-709f3d460ba2 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:07:37 user nova-compute[75293]: WARNING nova.compute.manager [req-d1aa4502-4469-4100-9440-cd19e5b0cad2 req-6728c0a5-8a66-455e-8fc7-3e152b051fc2 service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Received unexpected event network-vif-plugged-53964f53-7286-4710-bc56-709f3d460ba2 for instance with vm_state active and task_state None.
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.compute.manager [req-d1aa4502-4469-4100-9440-cd19e5b0cad2 req-6728c0a5-8a66-455e-8fc7-3e152b051fc2 service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Received event network-vif-plugged-53964f53-7286-4710-bc56-709f3d460ba2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d1aa4502-4469-4100-9440-cd19e5b0cad2 req-6728c0a5-8a66-455e-8fc7-3e152b051fc2 service nova] Acquiring lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d1aa4502-4469-4100-9440-cd19e5b0cad2 req-6728c0a5-8a66-455e-8fc7-3e152b051fc2 service nova] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d1aa4502-4469-4100-9440-cd19e5b0cad2 req-6728c0a5-8a66-455e-8fc7-3e152b051fc2 service nova] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.compute.manager [req-d1aa4502-4469-4100-9440-cd19e5b0cad2 req-6728c0a5-8a66-455e-8fc7-3e152b051fc2 service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] No waiting events found dispatching network-vif-plugged-53964f53-7286-4710-bc56-709f3d460ba2 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:07:37 user nova-compute[75293]: WARNING nova.compute.manager [req-d1aa4502-4469-4100-9440-cd19e5b0cad2 req-6728c0a5-8a66-455e-8fc7-3e152b051fc2 service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Received unexpected event network-vif-plugged-53964f53-7286-4710-bc56-709f3d460ba2 for instance with vm_state active and task_state None.
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.network.neutron [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Updating instance_info_cache with network_info: [{"id": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "address": "fa:16:3e:5a:44:78", "network": {"id": "1dfb2052-19d3-4cbe-9043-b01739b9b90e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-6334978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda1342c66f8477a830d140c3791d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca13e5bf-0c", "ovs_interfaceid": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Releasing lock "refresh_cache-ca1e65f3-8696-4c9a-b4df-ce5923e1de31" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.compute.manager [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Instance network_info: |[{"id": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "address": "fa:16:3e:5a:44:78", "network": {"id": "1dfb2052-19d3-4cbe-9043-b01739b9b90e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-6334978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda1342c66f8477a830d140c3791d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca13e5bf-0c", "ovs_interfaceid": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5ff3d860-cc0a-4f53-8359-efcbe7f0e6eb req-3756a969-8ed9-45ee-954f-6507db71b2b4 service nova] Acquired lock "refresh_cache-ca1e65f3-8696-4c9a-b4df-ce5923e1de31" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.network.neutron [req-5ff3d860-cc0a-4f53-8359-efcbe7f0e6eb req-3756a969-8ed9-45ee-954f-6507db71b2b4 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Refreshing network info cache for port ca13e5bf-0c02-4a9d-b23f-079495c5a34f {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Start _get_guest_xml network_info=[{"id": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "address": "fa:16:3e:5a:44:78", "network": {"id": "1dfb2052-19d3-4cbe-9043-b01739b9b90e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-6334978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda1342c66f8477a830d140c3791d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca13e5bf-0c", "ovs_interfaceid": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:07:37 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:37 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:07:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2042976883',display_name='tempest-VolumesAssistedSnapshotsTest-server-2042976883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2042976883',id=9,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7GKfigl5zV0JYLHby10rpA2dlbr3g1zE8cWvuFx/57b0XEwC1jSswE9eLXJv2GECSNGX2AmMitX6LTg6oS83CHMAx+/YIEFaZ+HIclXYJNk3PPhH51Jjw5eUzamW8vbQ==',key_name='tempest-keypair-1270876363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dda1342c66f8477a830d140c3791d1ea',ramdisk_id='',reservation_id='r-qjrlyj3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1277090279',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1277090279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:07:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61406119263a4a979ca668162d9e676a',uuid=ca1e65f3-8696-4c9a-b4df-ce5923e1de31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "address": "fa:16:3e:5a:44:78", "network": {"id": "1dfb2052-19d3-4cbe-9043-b01739b9b90e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-6334978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda1342c66f8477a830d140c3791d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca13e5bf-0c", "ovs_interfaceid": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Converting VIF {"id": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "address": "fa:16:3e:5a:44:78", "network": {"id": "1dfb2052-19d3-4cbe-9043-b01739b9b90e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-6334978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda1342c66f8477a830d140c3791d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca13e5bf-0c", "ovs_interfaceid": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:44:78,bridge_name='br-int',has_traffic_filtering=True,id=ca13e5bf-0c02-4a9d-b23f-079495c5a34f,network=Network(1dfb2052-19d3-4cbe-9043-b01739b9b90e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca13e5bf-0c') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.objects.instance [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Lazy-loading 'pci_devices' on Instance uuid ca1e65f3-8696-4c9a-b4df-ce5923e1de31 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:07:37 user nova-compute[75293]:   <uuid>ca1e65f3-8696-4c9a-b4df-ce5923e1de31</uuid>
Nov 30 07:07:37 user nova-compute[75293]:   <name>instance-00000009</name>
Nov 30 07:07:37 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:07:37 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:07:37 user nova-compute[75293]:   <metadata>
Nov 30 07:07:37 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:07:37 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:07:37 user nova-compute[75293]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-2042976883</nova:name>
Nov 30 07:07:37 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:07:37</nova:creationTime>
Nov 30 07:07:37 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:07:37 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:07:37 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:07:37 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:07:37 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:07:37 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:07:37 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:07:37 user nova-compute[75293]:       <nova:owner>
Nov 30 07:07:37 user nova-compute[75293]:         <nova:user uuid="61406119263a4a979ca668162d9e676a">tempest-VolumesAssistedSnapshotsTest-1277090279-project-member</nova:user>
Nov 30 07:07:37 user nova-compute[75293]:         <nova:project uuid="dda1342c66f8477a830d140c3791d1ea">tempest-VolumesAssistedSnapshotsTest-1277090279</nova:project>
Nov 30 07:07:37 user nova-compute[75293]:       </nova:owner>
Nov 30 07:07:37 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:07:37 user nova-compute[75293]:       <nova:ports>
Nov 30 07:07:37 user nova-compute[75293]:         <nova:port uuid="ca13e5bf-0c02-4a9d-b23f-079495c5a34f">
Nov 30 07:07:37 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 07:07:37 user nova-compute[75293]:         </nova:port>
Nov 30 07:07:37 user nova-compute[75293]:       </nova:ports>
Nov 30 07:07:37 user nova-compute[75293]:     </nova:instance>
Nov 30 07:07:37 user nova-compute[75293]:   </metadata>
Nov 30 07:07:37 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:07:37 user nova-compute[75293]:     <system>
Nov 30 07:07:37 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:07:37 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:07:37 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:07:37 user nova-compute[75293]:       <entry name="serial">ca1e65f3-8696-4c9a-b4df-ce5923e1de31</entry>
Nov 30 07:07:37 user nova-compute[75293]:       <entry name="uuid">ca1e65f3-8696-4c9a-b4df-ce5923e1de31</entry>
Nov 30 07:07:37 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:07:37 user nova-compute[75293]:     </system>
Nov 30 07:07:37 user nova-compute[75293]:   </sysinfo>
Nov 30 07:07:37 user nova-compute[75293]:   <os>
Nov 30 07:07:37 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:07:37 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:07:37 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:07:37 user nova-compute[75293]:   </os>
Nov 30 07:07:37 user nova-compute[75293]:   <features>
Nov 30 07:07:37 user nova-compute[75293]:     <acpi/>
Nov 30 07:07:37 user nova-compute[75293]:     <apic/>
Nov 30 07:07:37 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:07:37 user nova-compute[75293]:   </features>
Nov 30 07:07:37 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:07:37 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:07:37 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:07:37 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:07:37 user nova-compute[75293]:   </clock>
Nov 30 07:07:37 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:07:37 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:07:37 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:07:37 user nova-compute[75293]:   </cpu>
Nov 30 07:07:37 user nova-compute[75293]:   <devices>
Nov 30 07:07:37 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:07:37 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:07:37 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk"/>
Nov 30 07:07:37 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:07:37 user nova-compute[75293]:     </disk>
Nov 30 07:07:37 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:07:37 user nova-compute[75293]:       <mac address="fa:16:3e:5a:44:78"/>
Nov 30 07:07:37 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:07:37 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:07:37 user nova-compute[75293]:       <target dev="tapca13e5bf-0c"/>
Nov 30 07:07:37 user nova-compute[75293]:     </interface>
Nov 30 07:07:37 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:07:37 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/console.log" append="off"/>
Nov 30 07:07:37 user nova-compute[75293]:     </serial>
Nov 30 07:07:37 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:07:37 user nova-compute[75293]:     <video>
Nov 30 07:07:37 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:07:37 user nova-compute[75293]:     </video>
Nov 30 07:07:37 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:07:37 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:07:37 user nova-compute[75293]:     </rng>
Nov 30 07:07:37 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:07:37 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:07:37 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:07:37 user nova-compute[75293]:     </memballoon>
Nov 30 07:07:37 user nova-compute[75293]:   </devices>
Nov 30 07:07:37 user nova-compute[75293]: </domain>
Nov 30 07:07:37 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:07:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2042976883',display_name='tempest-VolumesAssistedSnapshotsTest-server-2042976883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2042976883',id=9,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7GKfigl5zV0JYLHby10rpA2dlbr3g1zE8cWvuFx/57b0XEwC1jSswE9eLXJv2GECSNGX2AmMitX6LTg6oS83CHMAx+/YIEFaZ+HIclXYJNk3PPhH51Jjw5eUzamW8vbQ==',key_name='tempest-keypair-1270876363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dda1342c66f8477a830d140c3791d1ea',ramdisk_id='',reservation_id='r-qjrlyj3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1277090279',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1277090279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:07:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61406119263a4a979ca668162d9e676a',uuid=ca1e65f3-8696-4c9a-b4df-ce5923e1de31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "address": "fa:16:3e:5a:44:78", "network": {"id": "1dfb2052-19d3-4cbe-9043-b01739b9b90e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-6334978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda1342c66f8477a830d140c3791d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca13e5bf-0c", "ovs_interfaceid": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Converting VIF {"id": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "address": "fa:16:3e:5a:44:78", "network": {"id": "1dfb2052-19d3-4cbe-9043-b01739b9b90e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-6334978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda1342c66f8477a830d140c3791d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca13e5bf-0c", "ovs_interfaceid": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:44:78,bridge_name='br-int',has_traffic_filtering=True,id=ca13e5bf-0c02-4a9d-b23f-079495c5a34f,network=Network(1dfb2052-19d3-4cbe-9043-b01739b9b90e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca13e5bf-0c') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG os_vif [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:44:78,bridge_name='br-int',has_traffic_filtering=True,id=ca13e5bf-0c02-4a9d-b23f-079495c5a34f,network=Network(1dfb2052-19d3-4cbe-9043-b01739b9b90e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca13e5bf-0c') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b4ebae2-f317-5676-be05-7ab41a398cfc', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca13e5bf-0c, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca13e5bf-0c, col_values=(('qos', UUID('13958fd1-0f49-4ffc-9c54-79de355c71f1')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca13e5bf-0c, col_values=(('external_ids', {'iface-id': 'ca13e5bf-0c02-4a9d-b23f-079495c5a34f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:44:78', 'vm-uuid': 'ca1e65f3-8696-4c9a-b4df-ce5923e1de31'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:37 user nova-compute[75293]: INFO os_vif [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:44:78,bridge_name='br-int',has_traffic_filtering=True,id=ca13e5bf-0c02-4a9d-b23f-079495c5a34f,network=Network(1dfb2052-19d3-4cbe-9043-b01739b9b90e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca13e5bf-0c')
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:07:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] No VIF found with MAC fa:16:3e:5a:44:78, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:07:38 user nova-compute[75293]: DEBUG nova.network.neutron [req-5ff3d860-cc0a-4f53-8359-efcbe7f0e6eb req-3756a969-8ed9-45ee-954f-6507db71b2b4 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Updated VIF entry in instance network info cache for port ca13e5bf-0c02-4a9d-b23f-079495c5a34f. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:07:38 user nova-compute[75293]: DEBUG nova.network.neutron [req-5ff3d860-cc0a-4f53-8359-efcbe7f0e6eb req-3756a969-8ed9-45ee-954f-6507db71b2b4 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Updating instance_info_cache with network_info: [{"id": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "address": "fa:16:3e:5a:44:78", "network": {"id": "1dfb2052-19d3-4cbe-9043-b01739b9b90e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-6334978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda1342c66f8477a830d140c3791d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca13e5bf-0c", "ovs_interfaceid": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:07:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5ff3d860-cc0a-4f53-8359-efcbe7f0e6eb req-3756a969-8ed9-45ee-954f-6507db71b2b4 service nova] Releasing lock "refresh_cache-ca1e65f3-8696-4c9a-b4df-ce5923e1de31" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:07:39 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:07:39 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Cleaning up deleted instances {{(pid=75293) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 07:07:39 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] There are 0 instances to clean {{(pid=75293) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 07:07:39 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:07:39 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75293) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 07:07:39 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:07:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:40 user nova-compute[75293]: DEBUG nova.compute.manager [req-dfd26ff9-6de5-4100-b1aa-5ca7a18714ef req-00c5eeaf-dec7-4250-a5fe-dcf3d8e9bcde service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Received event network-vif-plugged-ca13e5bf-0c02-4a9d-b23f-079495c5a34f {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-dfd26ff9-6de5-4100-b1aa-5ca7a18714ef req-00c5eeaf-dec7-4250-a5fe-dcf3d8e9bcde service nova] Acquiring lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-dfd26ff9-6de5-4100-b1aa-5ca7a18714ef req-00c5eeaf-dec7-4250-a5fe-dcf3d8e9bcde service nova] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-dfd26ff9-6de5-4100-b1aa-5ca7a18714ef req-00c5eeaf-dec7-4250-a5fe-dcf3d8e9bcde service nova] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:40 user nova-compute[75293]: DEBUG nova.compute.manager [req-dfd26ff9-6de5-4100-b1aa-5ca7a18714ef req-00c5eeaf-dec7-4250-a5fe-dcf3d8e9bcde service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] No waiting events found dispatching network-vif-plugged-ca13e5bf-0c02-4a9d-b23f-079495c5a34f {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:07:40 user nova-compute[75293]: WARNING nova.compute.manager [req-dfd26ff9-6de5-4100-b1aa-5ca7a18714ef req-00c5eeaf-dec7-4250-a5fe-dcf3d8e9bcde service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Received unexpected event network-vif-plugged-ca13e5bf-0c02-4a9d-b23f-079495c5a34f for instance with vm_state building and task_state spawning.
Nov 30 07:07:40 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:07:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:41 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:07:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:42 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:07:42 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:07:42 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:07:42 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:07:42 user nova-compute[75293]: DEBUG nova.compute.manager [req-9d4ff0bd-98ef-4524-b174-0fffba73a1d7 req-72d51885-c53e-4862-8ce9-cfc7405775e5 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Received event network-vif-plugged-ca13e5bf-0c02-4a9d-b23f-079495c5a34f {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:07:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9d4ff0bd-98ef-4524-b174-0fffba73a1d7 req-72d51885-c53e-4862-8ce9-cfc7405775e5 service nova] Acquiring lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9d4ff0bd-98ef-4524-b174-0fffba73a1d7 req-72d51885-c53e-4862-8ce9-cfc7405775e5 service nova] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9d4ff0bd-98ef-4524-b174-0fffba73a1d7 req-72d51885-c53e-4862-8ce9-cfc7405775e5 service nova] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:42 user nova-compute[75293]: DEBUG nova.compute.manager [req-9d4ff0bd-98ef-4524-b174-0fffba73a1d7 req-72d51885-c53e-4862-8ce9-cfc7405775e5 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] No waiting events found dispatching network-vif-plugged-ca13e5bf-0c02-4a9d-b23f-079495c5a34f {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:07:42 user nova-compute[75293]: WARNING nova.compute.manager [req-9d4ff0bd-98ef-4524-b174-0fffba73a1d7 req-72d51885-c53e-4862-8ce9-cfc7405775e5 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Received unexpected event network-vif-plugged-ca13e5bf-0c02-4a9d-b23f-079495c5a34f for instance with vm_state building and task_state spawning.
Nov 30 07:07:43 user nova-compute[75293]: DEBUG nova.compute.manager [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:07:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:07:43 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Instance spawned successfully.
Nov 30 07:07:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:07:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:07:43 user nova-compute[75293]: INFO nova.compute.manager [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Took 9.15 seconds to spawn the instance on the hypervisor.
Nov 30 07:07:43 user nova-compute[75293]: DEBUG nova.compute.manager [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:07:43 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:07:43 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:07:43 user nova-compute[75293]: INFO nova.compute.manager [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Took 10.59 seconds to build instance.
Nov 30 07:07:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03fe1db9-cb4d-471b-878f-4b910c3c93bc tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.917s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:45 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:07:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:45 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:07:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:47 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk --force-share --output=json" returned: 0 in 0.532s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:47 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:47 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk --force-share --output=json" returned: 0 in 0.371s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:47 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:47 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:47 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk --force-share --output=json" returned: 0 in 0.339s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk --force-share --output=json" returned: 0 in 0.352s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:07:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:07:51 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:51 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:07:51 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=7627MB free_disk=25.70238494873047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:07:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:07:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b6dee8d-d419-47a3-b2be-4d15e17d6061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b7deb0a-39af-4d93-b93d-5765a731f702 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 251604ac-b300-49ae-ae1a-4543665fead6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance bb71c604-7f7e-4b71-8fa3-56bd77b649c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance dcd1ca28-3784-45b3-a3d3-e3231d8e82bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 061832ab-930a-470b-8b4f-dfc8f19fea6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 67b8a66b-e7f8-41a1-8f5c-b29851ec608d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 4ca1e46c-e83f-4476-a225-79e83151e222 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance ca1e65f3-8696-4c9a-b4df-ce5923e1de31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Refreshing inventories for resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Updating ProviderTree inventory for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Updating inventory in ProviderTree for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Refreshing aggregate associations for resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa, aggregates: None {{(pid=75293) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Refreshing trait associations for resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV {{(pid=75293) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:07:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.957s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:07:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:53 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:07:53 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:07:53 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Rebuilding the list of instances to heal {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 07:07:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:07:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:07:54 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:07:54 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lazy-loading 'info_cache' on Instance uuid 1b6dee8d-d419-47a3-b2be-4d15e17d6061 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:07:54 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Updating instance_info_cache with network_info: [{"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:07:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:07:54 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:07:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:07:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:00 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:08:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:01 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:08:01 user nova-compute[75293]: INFO nova.compute.claims [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Claim successful on node user
Nov 30 07:08:01 user nova-compute[75293]: DEBUG nova.compute.manager [req-bcc14ca6-f784-4d19-8637-5f4385f38584 req-f7d70c55-c92f-4d09-9c8a-e289aba0d1db service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Received event network-vif-plugged-26f5514b-9205-4e17-9d2b-2196aaa085d2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-bcc14ca6-f784-4d19-8637-5f4385f38584 req-f7d70c55-c92f-4d09-9c8a-e289aba0d1db service nova] Acquiring lock "1b7deb0a-39af-4d93-b93d-5765a731f702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-bcc14ca6-f784-4d19-8637-5f4385f38584 req-f7d70c55-c92f-4d09-9c8a-e289aba0d1db service nova] Lock "1b7deb0a-39af-4d93-b93d-5765a731f702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-bcc14ca6-f784-4d19-8637-5f4385f38584 req-f7d70c55-c92f-4d09-9c8a-e289aba0d1db service nova] Lock "1b7deb0a-39af-4d93-b93d-5765a731f702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:01 user nova-compute[75293]: DEBUG nova.compute.manager [req-bcc14ca6-f784-4d19-8637-5f4385f38584 req-f7d70c55-c92f-4d09-9c8a-e289aba0d1db service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] No waiting events found dispatching network-vif-plugged-26f5514b-9205-4e17-9d2b-2196aaa085d2 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:01 user nova-compute[75293]: WARNING nova.compute.manager [req-bcc14ca6-f784-4d19-8637-5f4385f38584 req-f7d70c55-c92f-4d09-9c8a-e289aba0d1db service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Received unexpected event network-vif-plugged-26f5514b-9205-4e17-9d2b-2196aaa085d2 for instance with vm_state active and task_state None.
Nov 30 07:08:01 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:08:01 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:08:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:01 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:08:01 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:08:01 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:08:01 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:08:01 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:08:01 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:08:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:08:01 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Creating image(s)
Nov 30 07:08:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "/opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "/opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "a2a3299330f813c7c63ba937d6c15e833ef51b1a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "a2a3299330f813c7c63ba937d6c15e833ef51b1a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2a3299330f813c7c63ba937d6c15e833ef51b1a.part --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:02 user nova-compute[75293]: DEBUG nova.policy [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c37e36f7b5c4dfe815886140d24ea26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995a27035c0c4b59b4bc11ef5ed479e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:08:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2a3299330f813c7c63ba937d6c15e833ef51b1a.part --force-share --output=json" returned: 0 in 0.180s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:02 user nova-compute[75293]: DEBUG nova.virt.images [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] a1bf2a8e-e3eb-4347-ab61-743834e154b1 was qcow2, converting to raw {{(pid=75293) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 07:08:02 user nova-compute[75293]: DEBUG nova.privsep.utils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75293) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 07:08:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a2a3299330f813c7c63ba937d6c15e833ef51b1a.part /opt/stack/data/nova/instances/_base/a2a3299330f813c7c63ba937d6c15e833ef51b1a.converted {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a2a3299330f813c7c63ba937d6c15e833ef51b1a.part /opt/stack/data/nova/instances/_base/a2a3299330f813c7c63ba937d6c15e833ef51b1a.converted" returned: 0 in 0.146s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2a3299330f813c7c63ba937d6c15e833ef51b1a.converted --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:02 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:08:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2a3299330f813c7c63ba937d6c15e833ef51b1a.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "a2a3299330f813c7c63ba937d6c15e833ef51b1a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.094s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2a3299330f813c7c63ba937d6c15e833ef51b1a --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:02 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:08:02 user nova-compute[75293]: INFO nova.compute.claims [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Claim successful on node user
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2a3299330f813c7c63ba937d6c15e833ef51b1a --force-share --output=json" returned: 0 in 0.193s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "a2a3299330f813c7c63ba937d6c15e833ef51b1a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "a2a3299330f813c7c63ba937d6c15e833ef51b1a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2a3299330f813c7c63ba937d6c15e833ef51b1a --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2a3299330f813c7c63ba937d6c15e833ef51b1a --force-share --output=json" returned: 0 in 0.266s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a2a3299330f813c7c63ba937d6c15e833ef51b1a,backing_fmt=raw /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a2a3299330f813c7c63ba937d6c15e833ef51b1a,backing_fmt=raw /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk 1073741824" returned: 0 in 0.065s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "a2a3299330f813c7c63ba937d6c15e833ef51b1a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2a3299330f813c7c63ba937d6c15e833ef51b1a --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Successfully created port: fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Received event network-vif-plugged-26f5514b-9205-4e17-9d2b-2196aaa085d2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] Acquiring lock "1b7deb0a-39af-4d93-b93d-5765a731f702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] Lock "1b7deb0a-39af-4d93-b93d-5765a731f702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] Lock "1b7deb0a-39af-4d93-b93d-5765a731f702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] No waiting events found dispatching network-vif-plugged-26f5514b-9205-4e17-9d2b-2196aaa085d2 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:03 user nova-compute[75293]: WARNING nova.compute.manager [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Received unexpected event network-vif-plugged-26f5514b-9205-4e17-9d2b-2196aaa085d2 for instance with vm_state active and task_state None.
Nov 30 07:08:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Received event network-vif-plugged-60fdc1a9-8616-40a3-9380-b675ff1b3239 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] Acquiring lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] No waiting events found dispatching network-vif-plugged-60fdc1a9-8616-40a3-9380-b675ff1b3239 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:03 user nova-compute[75293]: WARNING nova.compute.manager [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Received unexpected event network-vif-plugged-60fdc1a9-8616-40a3-9380-b675ff1b3239 for instance with vm_state active and task_state None.
Nov 30 07:08:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Received event network-vif-plugged-60fdc1a9-8616-40a3-9380-b675ff1b3239 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] Acquiring lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] No waiting events found dispatching network-vif-plugged-60fdc1a9-8616-40a3-9380-b675ff1b3239 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:03 user nova-compute[75293]: WARNING nova.compute.manager [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Received unexpected event network-vif-plugged-60fdc1a9-8616-40a3-9380-b675ff1b3239 for instance with vm_state active and task_state None.
Nov 30 07:08:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Received event network-vif-plugged-0a97402b-7eac-4b1f-9697-19a03235d6ec {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] Acquiring lock "4ca1e46c-e83f-4476-a225-79e83151e222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] Lock "4ca1e46c-e83f-4476-a225-79e83151e222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] Lock "4ca1e46c-e83f-4476-a225-79e83151e222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] No waiting events found dispatching network-vif-plugged-0a97402b-7eac-4b1f-9697-19a03235d6ec {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:03 user nova-compute[75293]: WARNING nova.compute.manager [req-82972a9f-9729-4f9d-ac73-2505a5d97a43 req-31e9560a-b1b2-4d9c-b6a4-559544dcff3d service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Received unexpected event network-vif-plugged-0a97402b-7eac-4b1f-9697-19a03235d6ec for instance with vm_state active and task_state None.
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2a3299330f813c7c63ba937d6c15e833ef51b1a --force-share --output=json" returned: 0 in 0.189s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.820s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Cannot resize image /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Ensure instance console log exists: /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:08:03 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:08:03 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:08:03 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:08:03 user nova-compute[75293]: INFO nova.virt.block_device [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Booting with volume 58d71501-6e63-4411-b9fc-c951d0c71f50 at /dev/vda
Nov 30 07:08:04 user nova-compute[75293]: DEBUG os_brick.utils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:08:04 user nova-compute[75293]: INFO oslo.privsep.daemon [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpr_1yj7nc/privsep.sock']
Nov 30 07:08:04 user sudo[86408]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpr_1yj7nc/privsep.sock
Nov 30 07:08:04 user sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.policy [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '413a648e1b45497d9663faef32ad1a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62b7927ac1e441ca0897d81a5bb527e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Successfully updated port: fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquired lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Updating instance_info_cache with network_info: [{"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Releasing lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Instance network_info: |[{"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Start _get_guest_xml network_info=[{"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:07:58Z,direct_url=<?>,disk_format='qcow2',id=a1bf2a8e-e3eb-4347-ab61-743834e154b1,min_disk=0,min_ram=0,name='tempest-scenario-img--16228378',owner='995a27035c0c4b59b4bc11ef5ed479e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:08:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a1bf2a8e-e3eb-4347-ab61-743834e154b1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:08:04 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:08:04 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:07:58Z,direct_url=<?>,disk_format='qcow2',id=a1bf2a8e-e3eb-4347-ab61-743834e154b1,min_disk=0,min_ram=0,name='tempest-scenario-img--16228378',owner='995a27035c0c4b59b4bc11ef5ed479e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:08:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:08:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1186982627',display_name='tempest-TestMinimumBasicScenario-server-1186982627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1186982627',id=10,image_ref='a1bf2a8e-e3eb-4347-ab61-743834e154b1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMsqMmo5y5nrEe5/EAysBz/TZmoUguWfKbQBA8gdmeoccDDnOAjy5UCqnVUy3WWOjscjA4KGhVhWlQXcLk+3JBDwSAjPrQ2phWWgCzGRSuo5bA6deESyxfSvJVRmTiGJw==',key_name='tempest-TestMinimumBasicScenario-1562981580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='995a27035c0c4b59b4bc11ef5ed479e7',ramdisk_id='',reservation_id='r-bz3g0w69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a1bf2a8e-e3eb-4347-ab61-743834e154b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1736397132',owner_user_name='tempest-TestMinimumBasicScenario-1736397132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:02Z,user_data=None,user_id='6c37e36f7b5c4dfe815886140d24ea26',uuid=1d2d8481-7c11-42dd-b60f-0129aa3d3ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Converting VIF {"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:51:4d,bridge_name='br-int',has_traffic_filtering=True,id=fd8381e1-d2ff-4b1c-a6ed-704604abc20d,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd8381e1-d2') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.objects.instance [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:08:04 user nova-compute[75293]:   <uuid>1d2d8481-7c11-42dd-b60f-0129aa3d3ec8</uuid>
Nov 30 07:08:04 user nova-compute[75293]:   <name>instance-0000000a</name>
Nov 30 07:08:04 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:08:04 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:08:04 user nova-compute[75293]:   <metadata>
Nov 30 07:08:04 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:08:04 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:08:04 user nova-compute[75293]:       <nova:name>tempest-TestMinimumBasicScenario-server-1186982627</nova:name>
Nov 30 07:08:04 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:08:04</nova:creationTime>
Nov 30 07:08:04 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:08:04 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:08:04 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:08:04 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:08:04 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:08:04 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:08:04 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:08:04 user nova-compute[75293]:       <nova:owner>
Nov 30 07:08:04 user nova-compute[75293]:         <nova:user uuid="6c37e36f7b5c4dfe815886140d24ea26">tempest-TestMinimumBasicScenario-1736397132-project-member</nova:user>
Nov 30 07:08:04 user nova-compute[75293]:         <nova:project uuid="995a27035c0c4b59b4bc11ef5ed479e7">tempest-TestMinimumBasicScenario-1736397132</nova:project>
Nov 30 07:08:04 user nova-compute[75293]:       </nova:owner>
Nov 30 07:08:04 user nova-compute[75293]:       <nova:root type="image" uuid="a1bf2a8e-e3eb-4347-ab61-743834e154b1"/>
Nov 30 07:08:04 user nova-compute[75293]:       <nova:ports>
Nov 30 07:08:04 user nova-compute[75293]:         <nova:port uuid="fd8381e1-d2ff-4b1c-a6ed-704604abc20d">
Nov 30 07:08:04 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 07:08:04 user nova-compute[75293]:         </nova:port>
Nov 30 07:08:04 user nova-compute[75293]:       </nova:ports>
Nov 30 07:08:04 user nova-compute[75293]:     </nova:instance>
Nov 30 07:08:04 user nova-compute[75293]:   </metadata>
Nov 30 07:08:04 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:08:04 user nova-compute[75293]:     <system>
Nov 30 07:08:04 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:08:04 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:08:04 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:08:04 user nova-compute[75293]:       <entry name="serial">1d2d8481-7c11-42dd-b60f-0129aa3d3ec8</entry>
Nov 30 07:08:04 user nova-compute[75293]:       <entry name="uuid">1d2d8481-7c11-42dd-b60f-0129aa3d3ec8</entry>
Nov 30 07:08:04 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:08:04 user nova-compute[75293]:     </system>
Nov 30 07:08:04 user nova-compute[75293]:   </sysinfo>
Nov 30 07:08:04 user nova-compute[75293]:   <os>
Nov 30 07:08:04 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:08:04 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:08:04 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:08:04 user nova-compute[75293]:   </os>
Nov 30 07:08:04 user nova-compute[75293]:   <features>
Nov 30 07:08:04 user nova-compute[75293]:     <acpi/>
Nov 30 07:08:04 user nova-compute[75293]:     <apic/>
Nov 30 07:08:04 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:08:04 user nova-compute[75293]:   </features>
Nov 30 07:08:04 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:08:04 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:08:04 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:08:04 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:08:04 user nova-compute[75293]:   </clock>
Nov 30 07:08:04 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:08:04 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:08:04 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:08:04 user nova-compute[75293]:   </cpu>
Nov 30 07:08:04 user nova-compute[75293]:   <devices>
Nov 30 07:08:04 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:08:04 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:08:04 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk"/>
Nov 30 07:08:04 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:08:04 user nova-compute[75293]:     </disk>
Nov 30 07:08:04 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:08:04 user nova-compute[75293]:       <mac address="fa:16:3e:37:51:4d"/>
Nov 30 07:08:04 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:08:04 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:08:04 user nova-compute[75293]:       <target dev="tapfd8381e1-d2"/>
Nov 30 07:08:04 user nova-compute[75293]:     </interface>
Nov 30 07:08:04 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:08:04 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/console.log" append="off"/>
Nov 30 07:08:04 user nova-compute[75293]:     </serial>
Nov 30 07:08:04 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:08:04 user nova-compute[75293]:     <video>
Nov 30 07:08:04 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:08:04 user nova-compute[75293]:     </video>
Nov 30 07:08:04 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:08:04 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:08:04 user nova-compute[75293]:     </rng>
Nov 30 07:08:04 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:08:04 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:08:04 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:08:04 user nova-compute[75293]:     </memballoon>
Nov 30 07:08:04 user nova-compute[75293]:   </devices>
Nov 30 07:08:04 user nova-compute[75293]: </domain>
Nov 30 07:08:04 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:08:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1186982627',display_name='tempest-TestMinimumBasicScenario-server-1186982627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1186982627',id=10,image_ref='a1bf2a8e-e3eb-4347-ab61-743834e154b1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMsqMmo5y5nrEe5/EAysBz/TZmoUguWfKbQBA8gdmeoccDDnOAjy5UCqnVUy3WWOjscjA4KGhVhWlQXcLk+3JBDwSAjPrQ2phWWgCzGRSuo5bA6deESyxfSvJVRmTiGJw==',key_name='tempest-TestMinimumBasicScenario-1562981580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='995a27035c0c4b59b4bc11ef5ed479e7',ramdisk_id='',reservation_id='r-bz3g0w69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a1bf2a8e-e3eb-4347-ab61-743834e154b1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1736397132',owner_user_name='tempest-TestMinimumBasicScenario-1736397132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:02Z,user_data=None,user_id='6c37e36f7b5c4dfe815886140d24ea26',uuid=1d2d8481-7c11-42dd-b60f-0129aa3d3ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Converting VIF {"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:51:4d,bridge_name='br-int',has_traffic_filtering=True,id=fd8381e1-d2ff-4b1c-a6ed-704604abc20d,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd8381e1-d2') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG os_vif [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:51:4d,bridge_name='br-int',has_traffic_filtering=True,id=fd8381e1-d2ff-4b1c-a6ed-704604abc20d,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd8381e1-d2') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a49e63b1-6ff0-53b5-b0c7-384ff938144b', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd8381e1-d2, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd8381e1-d2, col_values=(('qos', UUID('1b24baa2-26ba-4b23-adf4-f2547358d894')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd8381e1-d2, col_values=(('external_ids', {'iface-id': 'fd8381e1-d2ff-4b1c-a6ed-704604abc20d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:51:4d', 'vm-uuid': '1d2d8481-7c11-42dd-b60f-0129aa3d3ec8'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:04 user nova-compute[75293]: INFO os_vif [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:51:4d,bridge_name='br-int',has_traffic_filtering=True,id=fd8381e1-d2ff-4b1c-a6ed-704604abc20d,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd8381e1-d2')
Nov 30 07:08:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] No VIF found with MAC fa:16:3e:37:51:4d, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Successfully created port: 5ef61853-620c-45df-9e8c-7ff595aecdf1 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:05 user sudo[86408]: pam_unix(sudo:session): session closed for user root
Nov 30 07:08:05 user nova-compute[75293]: INFO oslo.privsep.daemon [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Spawned new privsep daemon via rootwrap
Nov 30 07:08:05 user nova-compute[75293]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 30 07:08:05 user nova-compute[75293]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 30 07:08:05 user nova-compute[75293]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 30 07:08:05 user nova-compute[75293]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86417
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f284a422-8a8b-4d30-b037-787f5c17236a]: (2,) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG nova.compute.manager [req-6b21d8af-0dd5-4553-b471-39355c599027 req-d44707ed-bd34-4000-96f8-2abe65c454f1 service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Received event network-vif-plugged-0a97402b-7eac-4b1f-9697-19a03235d6ec {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6b21d8af-0dd5-4553-b471-39355c599027 req-d44707ed-bd34-4000-96f8-2abe65c454f1 service nova] Acquiring lock "4ca1e46c-e83f-4476-a225-79e83151e222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6b21d8af-0dd5-4553-b471-39355c599027 req-d44707ed-bd34-4000-96f8-2abe65c454f1 service nova] Lock "4ca1e46c-e83f-4476-a225-79e83151e222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6b21d8af-0dd5-4553-b471-39355c599027 req-d44707ed-bd34-4000-96f8-2abe65c454f1 service nova] Lock "4ca1e46c-e83f-4476-a225-79e83151e222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG nova.compute.manager [req-6b21d8af-0dd5-4553-b471-39355c599027 req-d44707ed-bd34-4000-96f8-2abe65c454f1 service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] No waiting events found dispatching network-vif-plugged-0a97402b-7eac-4b1f-9697-19a03235d6ec {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:05 user nova-compute[75293]: WARNING nova.compute.manager [req-6b21d8af-0dd5-4553-b471-39355c599027 req-d44707ed-bd34-4000-96f8-2abe65c454f1 service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Received unexpected event network-vif-plugged-0a97402b-7eac-4b1f-9697-19a03235d6ec for instance with vm_state active and task_state None.
Nov 30 07:08:05 user nova-compute[75293]: DEBUG nova.compute.manager [req-6b21d8af-0dd5-4553-b471-39355c599027 req-d44707ed-bd34-4000-96f8-2abe65c454f1 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received event network-changed-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG nova.compute.manager [req-6b21d8af-0dd5-4553-b471-39355c599027 req-d44707ed-bd34-4000-96f8-2abe65c454f1 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Refreshing instance network info cache due to event network-changed-fd8381e1-d2ff-4b1c-a6ed-704604abc20d. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6b21d8af-0dd5-4553-b471-39355c599027 req-d44707ed-bd34-4000-96f8-2abe65c454f1 service nova] Acquiring lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6b21d8af-0dd5-4553-b471-39355c599027 req-d44707ed-bd34-4000-96f8-2abe65c454f1 service nova] Acquired lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG nova.network.neutron [req-6b21d8af-0dd5-4553-b471-39355c599027 req-d44707ed-bd34-4000-96f8-2abe65c454f1 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Refreshing network info cache for port fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Successfully created port: b9ac9e07-c027-4b26-ab1f-fe548b6a74a9 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[218e153e-342a-43a1-ac0b-dd68308350c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:05 user nova-compute[75293]: WARNING os_brick.initiator.connectors.nvmeof [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[400ef5a7-885d-4583-9e3e-ce70ffd3756c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf61a23a-f87e-461b-8857-2a9452167216]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[804fcd04-befa-4620-8ba6-af436bc7ea4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:08:05 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:08:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0e6b73-d31a-4aa1-8323-91172d2cf66b]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG os_brick.utils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] <== get_connector_properties: return (1788ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:08:05 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Updating existing volume attachment record: 59b1e806-e8f0-436e-aa55-5899d73f6abc {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:08:06 user nova-compute[75293]: DEBUG nova.network.neutron [req-6b21d8af-0dd5-4553-b471-39355c599027 req-d44707ed-bd34-4000-96f8-2abe65c454f1 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Updated VIF entry in instance network info cache for port fd8381e1-d2ff-4b1c-a6ed-704604abc20d. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:08:06 user nova-compute[75293]: DEBUG nova.network.neutron [req-6b21d8af-0dd5-4553-b471-39355c599027 req-d44707ed-bd34-4000-96f8-2abe65c454f1 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Updating instance_info_cache with network_info: [{"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6b21d8af-0dd5-4553-b471-39355c599027 req-d44707ed-bd34-4000-96f8-2abe65c454f1 service nova] Releasing lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:06 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Successfully created port: ab42e005-7e8c-4b45-a30b-c4f1c743b3a4 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:08:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-41c58c0d-8922-4426-9606-14e814b5b009 req-1ac494b0-ef0a-4e13-992c-725b51c21343 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received event network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-41c58c0d-8922-4426-9606-14e814b5b009 req-1ac494b0-ef0a-4e13-992c-725b51c21343 service nova] Acquiring lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-41c58c0d-8922-4426-9606-14e814b5b009 req-1ac494b0-ef0a-4e13-992c-725b51c21343 service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-41c58c0d-8922-4426-9606-14e814b5b009 req-1ac494b0-ef0a-4e13-992c-725b51c21343 service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-41c58c0d-8922-4426-9606-14e814b5b009 req-1ac494b0-ef0a-4e13-992c-725b51c21343 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] No waiting events found dispatching network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:06 user nova-compute[75293]: WARNING nova.compute.manager [req-41c58c0d-8922-4426-9606-14e814b5b009 req-1ac494b0-ef0a-4e13-992c-725b51c21343 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received unexpected event network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d for instance with vm_state building and task_state spawning.
Nov 30 07:08:06 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:08:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:08:06 user nova-compute[75293]: INFO nova.compute.claims [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Claim successful on node user
Nov 30 07:08:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Successfully created port: a746d18c-574c-4c72-b3af-c5d7d6387f9c {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.594s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:08:07 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:08:07 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:08:07 user nova-compute[75293]: INFO nova.virt.block_device [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Booting with volume d46660fa-08d4-4b31-b4ca-3866a550c88c at /dev/vda
Nov 30 07:08:07 user nova-compute[75293]: DEBUG nova.policy [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7754783efd654868ab533fc179a7a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b4aec4e9794fa1bedce064018cc3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG os_brick.utils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19bc567-78d7-4ceb-adbb-e949d8c8a4d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6366cf5-62d8-4660-8213-84e47a69f831]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cb5a08-1b93-483d-9a3d-f7c18bd9ae03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acf57f8-5c26-4fea-a561-c1deacb30212]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Successfully created port: 177273b3-02d1-4f5c-ae31-70103280dd88 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:08:07 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:08:07 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e4d672-4a51-4ba5-92d2-5d75adb25c3e]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG os_brick.utils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:08:07 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updating existing volume attachment record: 25fdf2db-75e1-412d-9b0f-9e47e3f09a90 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Successfully created port: fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Successfully updated port: 5ef61853-620c-45df-9e8c-7ff595aecdf1 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-cba1ce63-f198-4b27-ac78-11b9e60aac91 req-145ffcf3-d92e-4724-bc6d-54ddfa4092ec service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received event network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cba1ce63-f198-4b27-ac78-11b9e60aac91 req-145ffcf3-d92e-4724-bc6d-54ddfa4092ec service nova] Acquiring lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cba1ce63-f198-4b27-ac78-11b9e60aac91 req-145ffcf3-d92e-4724-bc6d-54ddfa4092ec service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cba1ce63-f198-4b27-ac78-11b9e60aac91 req-145ffcf3-d92e-4724-bc6d-54ddfa4092ec service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-cba1ce63-f198-4b27-ac78-11b9e60aac91 req-145ffcf3-d92e-4724-bc6d-54ddfa4092ec service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] No waiting events found dispatching network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:08 user nova-compute[75293]: WARNING nova.compute.manager [req-cba1ce63-f198-4b27-ac78-11b9e60aac91 req-145ffcf3-d92e-4724-bc6d-54ddfa4092ec service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received unexpected event network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d for instance with vm_state building and task_state spawning.
Nov 30 07:08:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-cba1ce63-f198-4b27-ac78-11b9e60aac91 req-145ffcf3-d92e-4724-bc6d-54ddfa4092ec service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-changed-5ef61853-620c-45df-9e8c-7ff595aecdf1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-cba1ce63-f198-4b27-ac78-11b9e60aac91 req-145ffcf3-d92e-4724-bc6d-54ddfa4092ec service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Refreshing instance network info cache due to event network-changed-5ef61853-620c-45df-9e8c-7ff595aecdf1. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cba1ce63-f198-4b27-ac78-11b9e60aac91 req-145ffcf3-d92e-4724-bc6d-54ddfa4092ec service nova] Acquiring lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cba1ce63-f198-4b27-ac78-11b9e60aac91 req-145ffcf3-d92e-4724-bc6d-54ddfa4092ec service nova] Acquired lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG nova.network.neutron [req-cba1ce63-f198-4b27-ac78-11b9e60aac91 req-145ffcf3-d92e-4724-bc6d-54ddfa4092ec service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Refreshing network info cache for port 5ef61853-620c-45df-9e8c-7ff595aecdf1 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:08:08 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Instance spawned successfully.
Nov 30 07:08:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Successfully created port: b73c69b2-9f21-4615-80a4-7676df8071bd {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:08:08 user nova-compute[75293]: DEBUG nova.network.neutron [req-cba1ce63-f198-4b27-ac78-11b9e60aac91 req-145ffcf3-d92e-4724-bc6d-54ddfa4092ec service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:08:08 user nova-compute[75293]: INFO nova.compute.manager [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Took 7.13 seconds to spawn the instance on the hypervisor.
Nov 30 07:08:08 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:08:09 user nova-compute[75293]: INFO nova.compute.manager [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Took 7.98 seconds to build instance.
Nov 30 07:08:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d9a0c78c-5469-4f75-a504-818bb9a5f8a3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.065s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:09 user nova-compute[75293]: DEBUG nova.network.neutron [req-cba1ce63-f198-4b27-ac78-11b9e60aac91 req-145ffcf3-d92e-4724-bc6d-54ddfa4092ec service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cba1ce63-f198-4b27-ac78-11b9e60aac91 req-145ffcf3-d92e-4724-bc6d-54ddfa4092ec service nova] Releasing lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:09 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Successfully created port: 666a23fb-99db-4762-9181-18e0fbbbfdf2 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:08:09 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Successfully updated port: e8aa8c23-b7b1-4fed-80e2-ab511875b253 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:08:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:09 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Successfully created port: dbb92875-8448-4085-8275-c9cb21d80edf {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:08:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:10 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Successfully updated port: 3d552b1b-e03f-49a7-9f26-50748172b6d0 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:08:10 user nova-compute[75293]: DEBUG nova.compute.manager [req-f4be877c-99f2-4b57-80b8-4fe140c67b46 req-78b95678-06c7-46f4-bf38-dc6f39935feb service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-changed-e8aa8c23-b7b1-4fed-80e2-ab511875b253 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:10 user nova-compute[75293]: DEBUG nova.compute.manager [req-f4be877c-99f2-4b57-80b8-4fe140c67b46 req-78b95678-06c7-46f4-bf38-dc6f39935feb service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Refreshing instance network info cache due to event network-changed-e8aa8c23-b7b1-4fed-80e2-ab511875b253. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:08:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f4be877c-99f2-4b57-80b8-4fe140c67b46 req-78b95678-06c7-46f4-bf38-dc6f39935feb service nova] Acquiring lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f4be877c-99f2-4b57-80b8-4fe140c67b46 req-78b95678-06c7-46f4-bf38-dc6f39935feb service nova] Acquired lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:10 user nova-compute[75293]: DEBUG nova.network.neutron [req-f4be877c-99f2-4b57-80b8-4fe140c67b46 req-78b95678-06c7-46f4-bf38-dc6f39935feb service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Refreshing network info cache for port e8aa8c23-b7b1-4fed-80e2-ab511875b253 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:08:10 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Successfully created port: 09043b02-fceb-424b-9f68-a526293780c2 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:08:10 user nova-compute[75293]: DEBUG nova.network.neutron [req-f4be877c-99f2-4b57-80b8-4fe140c67b46 req-78b95678-06c7-46f4-bf38-dc6f39935feb service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG nova.network.neutron [req-f4be877c-99f2-4b57-80b8-4fe140c67b46 req-78b95678-06c7-46f4-bf38-dc6f39935feb service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f4be877c-99f2-4b57-80b8-4fe140c67b46 req-78b95678-06c7-46f4-bf38-dc6f39935feb service nova] Releasing lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-f4be877c-99f2-4b57-80b8-4fe140c67b46 req-78b95678-06c7-46f4-bf38-dc6f39935feb service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-changed-3d552b1b-e03f-49a7-9f26-50748172b6d0 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-f4be877c-99f2-4b57-80b8-4fe140c67b46 req-78b95678-06c7-46f4-bf38-dc6f39935feb service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Refreshing instance network info cache due to event network-changed-3d552b1b-e03f-49a7-9f26-50748172b6d0. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f4be877c-99f2-4b57-80b8-4fe140c67b46 req-78b95678-06c7-46f4-bf38-dc6f39935feb service nova] Acquiring lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f4be877c-99f2-4b57-80b8-4fe140c67b46 req-78b95678-06c7-46f4-bf38-dc6f39935feb service nova] Acquired lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG nova.network.neutron [req-f4be877c-99f2-4b57-80b8-4fe140c67b46 req-78b95678-06c7-46f4-bf38-dc6f39935feb service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Refreshing network info cache for port 3d552b1b-e03f-49a7-9f26-50748172b6d0 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG nova.network.neutron [req-f4be877c-99f2-4b57-80b8-4fe140c67b46 req-78b95678-06c7-46f4-bf38-dc6f39935feb service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Successfully updated port: b9ac9e07-c027-4b26-ab1f-fe548b6a74a9 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Successfully updated port: fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-748a846b-feea-478c-ba11-913f7098444d req-1def19d3-4276-4338-9f0b-4089b273e68f service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-changed-fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-748a846b-feea-478c-ba11-913f7098444d req-1def19d3-4276-4338-9f0b-4089b273e68f service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Refreshing instance network info cache due to event network-changed-fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-748a846b-feea-478c-ba11-913f7098444d req-1def19d3-4276-4338-9f0b-4089b273e68f service nova] Acquiring lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-748a846b-feea-478c-ba11-913f7098444d req-1def19d3-4276-4338-9f0b-4089b273e68f service nova] Acquired lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG nova.network.neutron [req-748a846b-feea-478c-ba11-913f7098444d req-1def19d3-4276-4338-9f0b-4089b273e68f service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Refreshing network info cache for port fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG nova.network.neutron [req-748a846b-feea-478c-ba11-913f7098444d req-1def19d3-4276-4338-9f0b-4089b273e68f service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG nova.network.neutron [req-f4be877c-99f2-4b57-80b8-4fe140c67b46 req-78b95678-06c7-46f4-bf38-dc6f39935feb service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f4be877c-99f2-4b57-80b8-4fe140c67b46 req-78b95678-06c7-46f4-bf38-dc6f39935feb service nova] Releasing lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG nova.network.neutron [req-748a846b-feea-478c-ba11-913f7098444d req-1def19d3-4276-4338-9f0b-4089b273e68f service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-748a846b-feea-478c-ba11-913f7098444d req-1def19d3-4276-4338-9f0b-4089b273e68f service nova] Releasing lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:12 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Successfully updated port: 60e4fab9-df41-42dd-be40-1300f77a7d89 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:08:12 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Successfully updated port: ab42e005-7e8c-4b45-a30b-c4f1c743b3a4 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:08:12 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Successfully updated port: b998882b-1d11-404b-930e-91b355ded504 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:08:12 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Successfully updated port: a746d18c-574c-4c72-b3af-c5d7d6387f9c {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:08:12 user nova-compute[75293]: DEBUG nova.compute.manager [req-fae552e0-25ca-4168-a717-bdde77b2f775 req-f2895356-36d5-4a53-b516-f9900dc8d2da service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-changed-b9ac9e07-c027-4b26-ab1f-fe548b6a74a9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:12 user nova-compute[75293]: DEBUG nova.compute.manager [req-fae552e0-25ca-4168-a717-bdde77b2f775 req-f2895356-36d5-4a53-b516-f9900dc8d2da service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Refreshing instance network info cache due to event network-changed-b9ac9e07-c027-4b26-ab1f-fe548b6a74a9. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:08:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fae552e0-25ca-4168-a717-bdde77b2f775 req-f2895356-36d5-4a53-b516-f9900dc8d2da service nova] Acquiring lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fae552e0-25ca-4168-a717-bdde77b2f775 req-f2895356-36d5-4a53-b516-f9900dc8d2da service nova] Acquired lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:12 user nova-compute[75293]: DEBUG nova.network.neutron [req-fae552e0-25ca-4168-a717-bdde77b2f775 req-f2895356-36d5-4a53-b516-f9900dc8d2da service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Refreshing network info cache for port b9ac9e07-c027-4b26-ab1f-fe548b6a74a9 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:08:13 user nova-compute[75293]: DEBUG nova.network.neutron [req-fae552e0-25ca-4168-a717-bdde77b2f775 req-f2895356-36d5-4a53-b516-f9900dc8d2da service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:08:13 user nova-compute[75293]: DEBUG nova.network.neutron [req-fae552e0-25ca-4168-a717-bdde77b2f775 req-f2895356-36d5-4a53-b516-f9900dc8d2da service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fae552e0-25ca-4168-a717-bdde77b2f775 req-f2895356-36d5-4a53-b516-f9900dc8d2da service nova] Releasing lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:13 user nova-compute[75293]: DEBUG nova.compute.manager [req-fae552e0-25ca-4168-a717-bdde77b2f775 req-f2895356-36d5-4a53-b516-f9900dc8d2da service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-changed-ab42e005-7e8c-4b45-a30b-c4f1c743b3a4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:13 user nova-compute[75293]: DEBUG nova.compute.manager [req-fae552e0-25ca-4168-a717-bdde77b2f775 req-f2895356-36d5-4a53-b516-f9900dc8d2da service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Refreshing instance network info cache due to event network-changed-ab42e005-7e8c-4b45-a30b-c4f1c743b3a4. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:08:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fae552e0-25ca-4168-a717-bdde77b2f775 req-f2895356-36d5-4a53-b516-f9900dc8d2da service nova] Acquiring lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fae552e0-25ca-4168-a717-bdde77b2f775 req-f2895356-36d5-4a53-b516-f9900dc8d2da service nova] Acquired lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:13 user nova-compute[75293]: DEBUG nova.network.neutron [req-fae552e0-25ca-4168-a717-bdde77b2f775 req-f2895356-36d5-4a53-b516-f9900dc8d2da service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Refreshing network info cache for port ab42e005-7e8c-4b45-a30b-c4f1c743b3a4 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:08:13 user nova-compute[75293]: DEBUG nova.network.neutron [req-fae552e0-25ca-4168-a717-bdde77b2f775 req-f2895356-36d5-4a53-b516-f9900dc8d2da service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:08:13 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Successfully updated port: b73c69b2-9f21-4615-80a4-7676df8071bd {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:08:13 user nova-compute[75293]: DEBUG nova.compute.manager [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-changed-60e4fab9-df41-42dd-be40-1300f77a7d89 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:13 user nova-compute[75293]: DEBUG nova.compute.manager [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Refreshing instance network info cache due to event network-changed-60e4fab9-df41-42dd-be40-1300f77a7d89. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:08:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] Acquiring lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] Acquired lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:13 user nova-compute[75293]: DEBUG nova.network.neutron [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Refreshing network info cache for port 60e4fab9-df41-42dd-be40-1300f77a7d89 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:08:13 user nova-compute[75293]: DEBUG nova.network.neutron [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:08:13 user nova-compute[75293]: DEBUG nova.network.neutron [req-fae552e0-25ca-4168-a717-bdde77b2f775 req-f2895356-36d5-4a53-b516-f9900dc8d2da service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fae552e0-25ca-4168-a717-bdde77b2f775 req-f2895356-36d5-4a53-b516-f9900dc8d2da service nova] Releasing lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG nova.network.neutron [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] Releasing lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG nova.compute.manager [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-changed-b998882b-1d11-404b-930e-91b355ded504 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG nova.compute.manager [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Refreshing instance network info cache due to event network-changed-b998882b-1d11-404b-930e-91b355ded504. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] Acquiring lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] Acquired lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG nova.network.neutron [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Refreshing network info cache for port b998882b-1d11-404b-930e-91b355ded504 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG nova.network.neutron [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Successfully updated port: 666a23fb-99db-4762-9181-18e0fbbbfdf2 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Successfully updated port: 177273b3-02d1-4f5c-ae31-70103280dd88 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Acquiring lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Acquired lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG nova.network.neutron [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] Releasing lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG nova.compute.manager [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-changed-b73c69b2-9f21-4615-80a4-7676df8071bd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG nova.compute.manager [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Refreshing instance network info cache due to event network-changed-b73c69b2-9f21-4615-80a4-7676df8071bd. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] Acquiring lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] Acquired lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG nova.network.neutron [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Refreshing network info cache for port b73c69b2-9f21-4615-80a4-7676df8071bd {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG nova.network.neutron [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:08:14 user nova-compute[75293]: INFO nova.virt.block_device [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Booting with volume be5917ae-7628-4e29-a1af-dea190f86765 at /dev/vdb
Nov 30 07:08:14 user nova-compute[75293]: DEBUG nova.compute.manager [req-1c8579e5-9d65-4ae0-9679-a882dcb95f75 req-f43fd67a-ad14-4234-be3a-616b3e4c46c0 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-changed-a746d18c-574c-4c72-b3af-c5d7d6387f9c {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG nova.compute.manager [req-1c8579e5-9d65-4ae0-9679-a882dcb95f75 req-f43fd67a-ad14-4234-be3a-616b3e4c46c0 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Refreshing instance network info cache due to event network-changed-a746d18c-574c-4c72-b3af-c5d7d6387f9c. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1c8579e5-9d65-4ae0-9679-a882dcb95f75 req-f43fd67a-ad14-4234-be3a-616b3e4c46c0 service nova] Acquiring lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG os_brick.utils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:14 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6151591c-1d4f-41d2-bc85-767fa90379b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c8109d-1b66-495c-b35d-2a1bfa31f84c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea14c1f2-30b9-4cf0-9260-aaa9d3dd3457]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[327f5f9b-dcfc-4041-add4-77130f0ade2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG nova.network.neutron [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e0e2337f-0a21-4f63-a558-95b0bec0fc13 req-ea6de662-3af9-449a-96c6-0b24a1e56fe0 service nova] Releasing lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:08:15 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:08:15 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d1a65c-535c-4e3c-bd13-776867c36c53]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG os_brick.utils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Updating existing volume attachment record: 4d125c32-6d91-4255-bc84-33b2ce7b9cd5 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Successfully updated port: dbb92875-8448-4085-8275-c9cb21d80edf {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-c223d4d3-1195-44ca-995d-d61cbbd069cb req-7e4ee467-ab09-4453-a0b1-f1ad53e45705 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-changed-666a23fb-99db-4762-9181-18e0fbbbfdf2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-c223d4d3-1195-44ca-995d-d61cbbd069cb req-7e4ee467-ab09-4453-a0b1-f1ad53e45705 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Refreshing instance network info cache due to event network-changed-666a23fb-99db-4762-9181-18e0fbbbfdf2. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c223d4d3-1195-44ca-995d-d61cbbd069cb req-7e4ee467-ab09-4453-a0b1-f1ad53e45705 service nova] Acquiring lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c223d4d3-1195-44ca-995d-d61cbbd069cb req-7e4ee467-ab09-4453-a0b1-f1ad53e45705 service nova] Acquired lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG nova.network.neutron [req-c223d4d3-1195-44ca-995d-d61cbbd069cb req-7e4ee467-ab09-4453-a0b1-f1ad53e45705 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Refreshing network info cache for port 666a23fb-99db-4762-9181-18e0fbbbfdf2 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:08:15 user nova-compute[75293]: DEBUG nova.network.neutron [req-c223d4d3-1195-44ca-995d-d61cbbd069cb req-7e4ee467-ab09-4453-a0b1-f1ad53e45705 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG nova.network.neutron [req-c223d4d3-1195-44ca-995d-d61cbbd069cb req-7e4ee467-ab09-4453-a0b1-f1ad53e45705 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c223d4d3-1195-44ca-995d-d61cbbd069cb req-7e4ee467-ab09-4453-a0b1-f1ad53e45705 service nova] Releasing lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Successfully updated port: 09043b02-fceb-424b-9f68-a526293780c2 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Acquiring lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Acquired lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Updating instance_info_cache with network_info: [{"id": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "address": "fa:16:3e:03:dc:1e", "network": {"id": "d6d10985-38b5-4e72-9276-76a246a2275e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1743986748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef61853-62", "ovs_interfaceid": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "address": "fa:16:3e:5f:38:ec", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa8c23-b7", "ovs_interfaceid": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "address": "fa:16:3e:12:ac:0e", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d552b1b-e0", "ovs_interfaceid": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "address": "fa:16:3e:a2:e2:22", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ac9e07-c0", "ovs_interfaceid": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "address": "fa:16:3e:d6:3f:bd", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab42e005-7e", "ovs_interfaceid": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "address": "fa:16:3e:4b:ef:61", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa746d18c-57", "ovs_interfaceid": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "177273b3-02d1-4f5c-ae31-70103280dd88", "address": "fa:16:3e:d3:53:db", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177273b3-02", "ovs_interfaceid": "177273b3-02d1-4f5c-ae31-70103280dd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Releasing lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Instance network_info: |[{"id": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "address": "fa:16:3e:03:dc:1e", "network": {"id": "d6d10985-38b5-4e72-9276-76a246a2275e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1743986748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef61853-62", "ovs_interfaceid": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "address": "fa:16:3e:5f:38:ec", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa8c23-b7", "ovs_interfaceid": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "address": "fa:16:3e:12:ac:0e", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d552b1b-e0", "ovs_interfaceid": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "address": "fa:16:3e:a2:e2:22", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ac9e07-c0", "ovs_interfaceid": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "address": "fa:16:3e:d6:3f:bd", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab42e005-7e", "ovs_interfaceid": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "address": "fa:16:3e:4b:ef:61", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa746d18c-57", "ovs_interfaceid": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "177273b3-02d1-4f5c-ae31-70103280dd88", "address": "fa:16:3e:d3:53:db", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177273b3-02", "ovs_interfaceid": "177273b3-02d1-4f5c-ae31-70103280dd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1c8579e5-9d65-4ae0-9679-a882dcb95f75 req-f43fd67a-ad14-4234-be3a-616b3e4c46c0 service nova] Acquired lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG nova.network.neutron [req-1c8579e5-9d65-4ae0-9679-a882dcb95f75 req-f43fd67a-ad14-4234-be3a-616b3e4c46c0 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Refreshing network info cache for port a746d18c-574c-4c72-b3af-c5d7d6387f9c {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG nova.network.neutron [req-1c8579e5-9d65-4ae0-9679-a882dcb95f75 req-f43fd67a-ad14-4234-be3a-616b3e4c46c0 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Updated VIF entry in instance network info cache for port a746d18c-574c-4c72-b3af-c5d7d6387f9c. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG nova.network.neutron [req-1c8579e5-9d65-4ae0-9679-a882dcb95f75 req-f43fd67a-ad14-4234-be3a-616b3e4c46c0 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Updating instance_info_cache with network_info: [{"id": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "address": "fa:16:3e:03:dc:1e", "network": {"id": "d6d10985-38b5-4e72-9276-76a246a2275e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1743986748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef61853-62", "ovs_interfaceid": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "address": "fa:16:3e:5f:38:ec", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa8c23-b7", "ovs_interfaceid": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "address": "fa:16:3e:12:ac:0e", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d552b1b-e0", "ovs_interfaceid": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "address": "fa:16:3e:a2:e2:22", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ac9e07-c0", "ovs_interfaceid": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "address": "fa:16:3e:d6:3f:bd", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab42e005-7e", "ovs_interfaceid": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "address": "fa:16:3e:4b:ef:61", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa746d18c-57", "ovs_interfaceid": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "177273b3-02d1-4f5c-ae31-70103280dd88", "address": "fa:16:3e:d3:53:db", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177273b3-02", "ovs_interfaceid": "177273b3-02d1-4f5c-ae31-70103280dd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:16 user nova-compute[75293]: INFO nova.virt.block_device [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Booting with volume f80c421f-f8ec-4cc7-86ee-59ef34a74c89 at /dev/vdb
Nov 30 07:08:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1c8579e5-9d65-4ae0-9679-a882dcb95f75 req-f43fd67a-ad14-4234-be3a-616b3e4c46c0 service nova] Releasing lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG nova.compute.manager [req-1c8579e5-9d65-4ae0-9679-a882dcb95f75 req-f43fd67a-ad14-4234-be3a-616b3e4c46c0 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-changed-177273b3-02d1-4f5c-ae31-70103280dd88 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG nova.compute.manager [req-1c8579e5-9d65-4ae0-9679-a882dcb95f75 req-f43fd67a-ad14-4234-be3a-616b3e4c46c0 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Refreshing instance network info cache due to event network-changed-177273b3-02d1-4f5c-ae31-70103280dd88. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1c8579e5-9d65-4ae0-9679-a882dcb95f75 req-f43fd67a-ad14-4234-be3a-616b3e4c46c0 service nova] Acquiring lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1c8579e5-9d65-4ae0-9679-a882dcb95f75 req-f43fd67a-ad14-4234-be3a-616b3e4c46c0 service nova] Acquired lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG nova.network.neutron [req-1c8579e5-9d65-4ae0-9679-a882dcb95f75 req-f43fd67a-ad14-4234-be3a-616b3e4c46c0 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Refreshing network info cache for port 177273b3-02d1-4f5c-ae31-70103280dd88 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG os_brick.utils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[84aaaf73-7cf5-46cc-8b76-68b2de5c337b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba7a1ba-4dab-4577-8047-73fcc592c9de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG nova.compute.manager [req-4e6a8c62-087f-4e37-a4c1-4f7c4a1219cf req-88ff3edb-21c8-4bf1-af14-2dac8303763f service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-changed-dbb92875-8448-4085-8275-c9cb21d80edf {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:16 user nova-compute[75293]: DEBUG nova.compute.manager [req-4e6a8c62-087f-4e37-a4c1-4f7c4a1219cf req-88ff3edb-21c8-4bf1-af14-2dac8303763f service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Refreshing instance network info cache due to event network-changed-dbb92875-8448-4085-8275-c9cb21d80edf. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:08:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4e6a8c62-087f-4e37-a4c1-4f7c4a1219cf req-88ff3edb-21c8-4bf1-af14-2dac8303763f service nova] Acquiring lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe298439-de41-49e8-bf59-ca8dab034914]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[48acbb53-2c03-4ba4-90d4-1d0f0dcf9d0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:08:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:08:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:08:17 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:08:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[063510eb-e5f7-42b0-96fa-7dd5d66c2e74]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:08:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:08:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:08:17 user nova-compute[75293]: DEBUG os_brick.utils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:08:17 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updating existing volume attachment record: 0edc82ad-205e-48d0-b389-9b12d550ff38 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:08:17 user nova-compute[75293]: DEBUG nova.network.neutron [req-1c8579e5-9d65-4ae0-9679-a882dcb95f75 req-f43fd67a-ad14-4234-be3a-616b3e4c46c0 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Updated VIF entry in instance network info cache for port 177273b3-02d1-4f5c-ae31-70103280dd88. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:08:17 user nova-compute[75293]: DEBUG nova.network.neutron [req-1c8579e5-9d65-4ae0-9679-a882dcb95f75 req-f43fd67a-ad14-4234-be3a-616b3e4c46c0 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Updating instance_info_cache with network_info: [{"id": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "address": "fa:16:3e:03:dc:1e", "network": {"id": "d6d10985-38b5-4e72-9276-76a246a2275e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1743986748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef61853-62", "ovs_interfaceid": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "address": "fa:16:3e:5f:38:ec", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa8c23-b7", "ovs_interfaceid": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "address": "fa:16:3e:12:ac:0e", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d552b1b-e0", "ovs_interfaceid": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "address": "fa:16:3e:a2:e2:22", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ac9e07-c0", "ovs_interfaceid": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "address": "fa:16:3e:d6:3f:bd", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab42e005-7e", "ovs_interfaceid": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "address": "fa:16:3e:4b:ef:61", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa746d18c-57", "ovs_interfaceid": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "177273b3-02d1-4f5c-ae31-70103280dd88", "address": "fa:16:3e:d3:53:db", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177273b3-02", "ovs_interfaceid": "177273b3-02d1-4f5c-ae31-70103280dd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1c8579e5-9d65-4ae0-9679-a882dcb95f75 req-f43fd67a-ad14-4234-be3a-616b3e4c46c0 service nova] Releasing lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:18 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updating instance_info_cache with network_info: [{"id": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "address": "fa:16:3e:45:27:91", "network": {"id": "dcc0a646-3097-4d7c-8d41-a5cd415c9ec3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1268388523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb623d7c-b0", "ovs_interfaceid": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60e4fab9-df41-42dd-be40-1300f77a7d89", "address": "fa:16:3e:01:72:2a", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e4fab9-df", "ovs_interfaceid": "60e4fab9-df41-42dd-be40-1300f77a7d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b998882b-1d11-404b-930e-91b355ded504", "address": "fa:16:3e:82:f1:9d", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb998882b-1d", "ovs_interfaceid": "b998882b-1d11-404b-930e-91b355ded504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b73c69b2-9f21-4615-80a4-7676df8071bd", "address": "fa:16:3e:28:00:25", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73c69b2-9f", "ovs_interfaceid": "b73c69b2-9f21-4615-80a4-7676df8071bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "address": "fa:16:3e:c2:fb:c4", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666a23fb-99", "ovs_interfaceid": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb92875-8448-4085-8275-c9cb21d80edf", "address": "fa:16:3e:a5:35:29", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb92875-84", "ovs_interfaceid": "dbb92875-8448-4085-8275-c9cb21d80edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09043b02-fceb-424b-9f68-a526293780c2", "address": "fa:16:3e:82:90:d6", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09043b02-fc", "ovs_interfaceid": "09043b02-fceb-424b-9f68-a526293780c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Releasing lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:18 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Instance network_info: |[{"id": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "address": "fa:16:3e:45:27:91", "network": {"id": "dcc0a646-3097-4d7c-8d41-a5cd415c9ec3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1268388523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb623d7c-b0", "ovs_interfaceid": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60e4fab9-df41-42dd-be40-1300f77a7d89", "address": "fa:16:3e:01:72:2a", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e4fab9-df", "ovs_interfaceid": "60e4fab9-df41-42dd-be40-1300f77a7d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b998882b-1d11-404b-930e-91b355ded504", "address": "fa:16:3e:82:f1:9d", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb998882b-1d", "ovs_interfaceid": "b998882b-1d11-404b-930e-91b355ded504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b73c69b2-9f21-4615-80a4-7676df8071bd", "address": "fa:16:3e:28:00:25", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73c69b2-9f", "ovs_interfaceid": "b73c69b2-9f21-4615-80a4-7676df8071bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "address": "fa:16:3e:c2:fb:c4", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666a23fb-99", "ovs_interfaceid": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb92875-8448-4085-8275-c9cb21d80edf", "address": "fa:16:3e:a5:35:29", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb92875-84", "ovs_interfaceid": "dbb92875-8448-4085-8275-c9cb21d80edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09043b02-fceb-424b-9f68-a526293780c2", "address": "fa:16:3e:82:90:d6", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09043b02-fc", "ovs_interfaceid": "09043b02-fceb-424b-9f68-a526293780c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:08:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4e6a8c62-087f-4e37-a4c1-4f7c4a1219cf req-88ff3edb-21c8-4bf1-af14-2dac8303763f service nova] Acquired lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:18 user nova-compute[75293]: DEBUG nova.network.neutron [req-4e6a8c62-087f-4e37-a4c1-4f7c4a1219cf req-88ff3edb-21c8-4bf1-af14-2dac8303763f service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Refreshing network info cache for port dbb92875-8448-4085-8275-c9cb21d80edf {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:08:18 user nova-compute[75293]: DEBUG nova.network.neutron [req-4e6a8c62-087f-4e37-a4c1-4f7c4a1219cf req-88ff3edb-21c8-4bf1-af14-2dac8303763f service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updated VIF entry in instance network info cache for port dbb92875-8448-4085-8275-c9cb21d80edf. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:08:18 user nova-compute[75293]: DEBUG nova.network.neutron [req-4e6a8c62-087f-4e37-a4c1-4f7c4a1219cf req-88ff3edb-21c8-4bf1-af14-2dac8303763f service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updating instance_info_cache with network_info: [{"id": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "address": "fa:16:3e:45:27:91", "network": {"id": "dcc0a646-3097-4d7c-8d41-a5cd415c9ec3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1268388523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb623d7c-b0", "ovs_interfaceid": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60e4fab9-df41-42dd-be40-1300f77a7d89", "address": "fa:16:3e:01:72:2a", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e4fab9-df", "ovs_interfaceid": "60e4fab9-df41-42dd-be40-1300f77a7d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b998882b-1d11-404b-930e-91b355ded504", "address": "fa:16:3e:82:f1:9d", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb998882b-1d", "ovs_interfaceid": "b998882b-1d11-404b-930e-91b355ded504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b73c69b2-9f21-4615-80a4-7676df8071bd", "address": "fa:16:3e:28:00:25", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73c69b2-9f", "ovs_interfaceid": "b73c69b2-9f21-4615-80a4-7676df8071bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "address": "fa:16:3e:c2:fb:c4", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666a23fb-99", "ovs_interfaceid": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb92875-8448-4085-8275-c9cb21d80edf", "address": "fa:16:3e:a5:35:29", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb92875-84", "ovs_interfaceid": "dbb92875-8448-4085-8275-c9cb21d80edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09043b02-fceb-424b-9f68-a526293780c2", "address": "fa:16:3e:82:90:d6", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09043b02-fc", "ovs_interfaceid": "09043b02-fceb-424b-9f68-a526293780c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4e6a8c62-087f-4e37-a4c1-4f7c4a1219cf req-88ff3edb-21c8-4bf1-af14-2dac8303763f service nova] Releasing lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:18 user nova-compute[75293]: DEBUG nova.compute.manager [req-4e6a8c62-087f-4e37-a4c1-4f7c4a1219cf req-88ff3edb-21c8-4bf1-af14-2dac8303763f service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-changed-09043b02-fceb-424b-9f68-a526293780c2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:18 user nova-compute[75293]: DEBUG nova.compute.manager [req-4e6a8c62-087f-4e37-a4c1-4f7c4a1219cf req-88ff3edb-21c8-4bf1-af14-2dac8303763f service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Refreshing instance network info cache due to event network-changed-09043b02-fceb-424b-9f68-a526293780c2. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:08:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4e6a8c62-087f-4e37-a4c1-4f7c4a1219cf req-88ff3edb-21c8-4bf1-af14-2dac8303763f service nova] Acquiring lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4e6a8c62-087f-4e37-a4c1-4f7c4a1219cf req-88ff3edb-21c8-4bf1-af14-2dac8303763f service nova] Acquired lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:18 user nova-compute[75293]: DEBUG nova.network.neutron [req-4e6a8c62-087f-4e37-a4c1-4f7c4a1219cf req-88ff3edb-21c8-4bf1-af14-2dac8303763f service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Refreshing network info cache for port 09043b02-fceb-424b-9f68-a526293780c2 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:08:18 user nova-compute[75293]: DEBUG nova.network.neutron [req-4e6a8c62-087f-4e37-a4c1-4f7c4a1219cf req-88ff3edb-21c8-4bf1-af14-2dac8303763f service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updated VIF entry in instance network info cache for port 09043b02-fceb-424b-9f68-a526293780c2. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:08:18 user nova-compute[75293]: DEBUG nova.network.neutron [req-4e6a8c62-087f-4e37-a4c1-4f7c4a1219cf req-88ff3edb-21c8-4bf1-af14-2dac8303763f service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updating instance_info_cache with network_info: [{"id": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "address": "fa:16:3e:45:27:91", "network": {"id": "dcc0a646-3097-4d7c-8d41-a5cd415c9ec3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1268388523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb623d7c-b0", "ovs_interfaceid": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60e4fab9-df41-42dd-be40-1300f77a7d89", "address": "fa:16:3e:01:72:2a", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e4fab9-df", "ovs_interfaceid": "60e4fab9-df41-42dd-be40-1300f77a7d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b998882b-1d11-404b-930e-91b355ded504", "address": "fa:16:3e:82:f1:9d", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb998882b-1d", "ovs_interfaceid": "b998882b-1d11-404b-930e-91b355ded504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b73c69b2-9f21-4615-80a4-7676df8071bd", "address": "fa:16:3e:28:00:25", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73c69b2-9f", "ovs_interfaceid": "b73c69b2-9f21-4615-80a4-7676df8071bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "address": "fa:16:3e:c2:fb:c4", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666a23fb-99", "ovs_interfaceid": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb92875-8448-4085-8275-c9cb21d80edf", "address": "fa:16:3e:a5:35:29", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb92875-84", "ovs_interfaceid": "dbb92875-8448-4085-8275-c9cb21d80edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09043b02-fceb-424b-9f68-a526293780c2", "address": "fa:16:3e:82:90:d6", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09043b02-fc", "ovs_interfaceid": "09043b02-fceb-424b-9f68-a526293780c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4e6a8c62-087f-4e37-a4c1-4f7c4a1219cf req-88ff3edb-21c8-4bf1-af14-2dac8303763f service nova] Releasing lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:23 user nova-compute[75293]: INFO nova.virt.block_device [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Booting with volume 178a4b07-0dd0-43e8-9303-99763655fc14 at /dev/vdc
Nov 30 07:08:23 user nova-compute[75293]: DEBUG os_brick.utils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e297c97d-0821-449f-9df2-974bcb5b4f08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf5b2ab-0d44-4693-a4ab-73896b67ab40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcec36f-5c84-49d2-90a9-cb778e388d4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e46f3a-4566-4cc2-af2f-a5e66bd6ed6e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:08:23 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:08:23 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c19c6ff-8863-422a-b09c-cf5dd65929cc]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG os_brick.utils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:08:23 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Updating existing volume attachment record: fabe7f46-c0c4-4165-9c1e-e7fa5c0f4214 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:08:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:25 user nova-compute[75293]: INFO nova.virt.block_device [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Booting with volume bb80b1dd-cfed-46f4-a524-f66fda55bf51 at /dev/vdc
Nov 30 07:08:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG os_brick.utils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[128c0856-cae7-4424-ad6c-184497f0330a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e408af6a-75ef-4621-873c-92a9736c37e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[723e61f7-2f69-4838-a432-f3373b261643]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc4c703-1f95-4405-971c-0a67bcab3669]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:08:25 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:08:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cd6ee4-ebcc-45eb-9e4b-e7c5bc6b54df]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG os_brick.utils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:08:25 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updating existing volume attachment record: 88e21685-7b34-4ddd-9808-191963714d89 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:08:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:08:32 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Creating image(s)
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Did not create local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Ensure instance console log exists: /opt/stack/data/nova/instances/09b63cd9-2f63-411d-886d-3ff237d145d0/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Start _get_guest_xml network_info=[{"id": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "address": "fa:16:3e:03:dc:1e", "network": {"id": "d6d10985-38b5-4e72-9276-76a246a2275e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1743986748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef61853-62", "ovs_interfaceid": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "address": "fa:16:3e:5f:38:ec", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa8c23-b7", "ovs_interfaceid": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "address": "fa:16:3e:12:ac:0e", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d552b1b-e0", "ovs_interfaceid": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "address": "fa:16:3e:a2:e2:22", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ac9e07-c0", "ovs_interfaceid": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "address": "fa:16:3e:d6:3f:bd", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab42e005-7e", "ovs_interfaceid": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "address": "fa:16:3e:4b:ef:61", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa746d18c-57", "ovs_interfaceid": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "177273b3-02d1-4f5c-ae31-70103280dd88", "address": "fa:16:3e:d3:53:db", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177273b3-02", "ovs_interfaceid": "177273b3-02d1-4f5c-ae31-70103280dd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVDxHjWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '09b63cd9-2f63-411d-886d-3ff237d145d0', 'attached_at': '', 'detached_at': '', 'volume_id': '58d71501-6e63-4411-b9fc-c951d0c71f50', 'serial': '58d71501-6e63-4411-b9fc-c951d0c71f50'}, 'delete_on_termination': False, 'attachment_id': '59b1e806-e8f0-436e-aa55-5899d73f6abc', 'volume_type': None}, {'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': 1, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSBQCLqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '09b63cd9-2f63-411d-886d-3ff237d145d0', 'attached_at': '', 'detached_at': '', 'volume_id': 'be5917ae-7628-4e29-a1af-dea190f86765', 'serial': 'be5917ae-7628-4e29-a1af-dea190f86765'}, 'delete_on_termination': False, 'attachment_id': '4d125c32-6d91-4255-bc84-33b2ce7b9cd5', 'volume_type': None}, {'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': 2, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMedBsOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '09b63cd9-2f63-411d-886d-3ff237d145d0', 'attached_at': '', 'detached_at': '', 'volume_id': '178a4b07-0dd0-43e8-9303-99763655fc14', 'serial': '178a4b07-0dd0-43e8-9303-99763655fc14'}, 'delete_on_termination': False, 'attachment_id': 'fabe7f46-c0c4-4165-9c1e-e7fa5c0f4214', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:08:32 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:08:32 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connector [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Factory for ISCSI on None {{(pid=75293) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVDxHjWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:08:32 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:08:32 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:08:32 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8714da-baf5-4b31-bbd9-ac91e62bacd5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:08:32 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf33fe99-3754-43f8-a8db-c6c4b497789c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50] added
Nov 30 07:08:32 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bd3b09-a161-4f78-a19a-59abeef68f7e]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce078d2-6da0-43b9-8922-782328b782d1]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pVDxHjWt {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pVDxHjWt" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[08eb7120-cc66-42bb-b0ef-39070bcc77f3]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pVDxHjWt'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[be01fdab-df19-4b9b-8c7c-375b53599020]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[366d85df-6bc6-4736-a01b-29f3c2206736]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 07:08:32 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 07:08:32 user nova-compute[75293]:  {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:08:32 user nova-compute[75293]: WARNING os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 07:08:32 user nova-compute[75293]: 
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76eb5a7-aa72-4b72-a69e-99d48efefac7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50, portal: 172.16.0.220,3260]
Nov 30 07:08:32 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50, portal: 172.16.0.220,3260] successful.
Nov 30 07:08:32 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcbbd60-99e9-49ae-8a3a-ada0ef95d5aa]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f11407a-1b4f-49fc-aee3-490f6710dda6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:32 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:32 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d666c47b-3d97-49c9-8871-dea1704e6b97]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:08:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVDxHjWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23131316335363866', 'path': '/dev/sdb'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131316335363866', 'path': '/dev/sdb'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSBQCLqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:08:33 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:08:33 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:08:33 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbe4cde-6b5c-4578-a000-a36626e61f33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:08:33 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ebc6bf-8f7b-4d4e-8876-ab7a9bc85876]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765] added
Nov 30 07:08:33 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f3b43b-0653-4702-8b59-c5934dbe4348]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efd4ea3-6956-452f-af95-a55471c5faf0]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hSBQCLqV {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hSBQCLqV" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[34db1624-7e16-4ed0-8ef2-4bfee8cd51ec]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hSBQCLqV'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dbe36c-6f43-430d-b830-1b08820652cf]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b95c55-c0fc-40d9-b736-090711b47072]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:33 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:33 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d411f17-bdbb-46e3-ad79-af7956cc1ac6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765, portal: 172.16.0.220,3260]
Nov 30 07:08:33 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765, portal: 172.16.0.220,3260] successful.
Nov 30 07:08:33 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5db028b-92d6-49d4-9d89-cc57bfc10b1d]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[652702f9-4ba6-4331-9ac6-d159a85a467d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:33 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:08:33 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:33 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:08:33 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f93967-7cd9-475a-ae6f-8b5e52ac9c3e]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSBQCLqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:08:33 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Creating image(s)
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Did not create local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Ensure instance console log exists: /opt/stack/data/nova/instances/cc583d29-3df4-4406-b5a5-f4b3d300fabb/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Start _get_guest_xml network_info=[{"id": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "address": "fa:16:3e:45:27:91", "network": {"id": "dcc0a646-3097-4d7c-8d41-a5cd415c9ec3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1268388523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb623d7c-b0", "ovs_interfaceid": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60e4fab9-df41-42dd-be40-1300f77a7d89", "address": "fa:16:3e:01:72:2a", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e4fab9-df", "ovs_interfaceid": "60e4fab9-df41-42dd-be40-1300f77a7d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b998882b-1d11-404b-930e-91b355ded504", "address": "fa:16:3e:82:f1:9d", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb998882b-1d", "ovs_interfaceid": "b998882b-1d11-404b-930e-91b355ded504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b73c69b2-9f21-4615-80a4-7676df8071bd", "address": "fa:16:3e:28:00:25", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73c69b2-9f", "ovs_interfaceid": "b73c69b2-9f21-4615-80a4-7676df8071bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "address": "fa:16:3e:c2:fb:c4", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666a23fb-99", "ovs_interfaceid": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb92875-8448-4085-8275-c9cb21d80edf", "address": "fa:16:3e:a5:35:29", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb92875-84", "ovs_interfaceid": "dbb92875-8448-4085-8275-c9cb21d80edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09043b02-fceb-424b-9f68-a526293780c2", "address": "fa:16:3e:82:90:d6", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09043b02-fc", "ovs_interfaceid": "09043b02-fceb-424b-9f68-a526293780c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egiQsvFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cc583d29-3df4-4406-b5a5-f4b3d300fabb', 'attached_at': '', 'detached_at': '', 'volume_id': 'd46660fa-08d4-4b31-b4ca-3866a550c88c', 'serial': 'd46660fa-08d4-4b31-b4ca-3866a550c88c'}, 'delete_on_termination': False, 'attachment_id': '25fdf2db-75e1-412d-9b0f-9e47e3f09a90', 'volume_type': None}, {'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': 1, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNOSmAkq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cc583d29-3df4-4406-b5a5-f4b3d300fabb', 'attached_at': '', 'detached_at': '', 'volume_id': 'f80c421f-f8ec-4cc7-86ee-59ef34a74c89', 'serial': 'f80c421f-f8ec-4cc7-86ee-59ef34a74c89'}, 'delete_on_termination': False, 'attachment_id': '0edc82ad-205e-48d0-b389-9b12d550ff38', 'volume_type': None}, {'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': 2, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEqsjIOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cc583d29-3df4-4406-b5a5-f4b3d300fabb', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb80b1dd-cfed-46f4-a524-f66fda55bf51', 'serial': 'bb80b1dd-cfed-46f4-a524-f66fda55bf51'}, 'delete_on_termination': False, 'attachment_id': '88e21685-7b34-4ddd-9808-191963714d89', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:08:33 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:08:33 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egiQsvFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:08:33 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:08:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26463613064326438', 'path': '/dev/sdc'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463613064326438', 'path': '/dev/sdc'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.872s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:08:34 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:08:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:08:34 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feace4f-22ba-4f58-a42f-5b1aafed78a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:08:34 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMedBsOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:08:34 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:08:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2667fc-2660-4681-9e4c-6fde92e473bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c] added
Nov 30 07:08:34 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ce1b0d-9452-4209-9f23-f0aad959b78b]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fc43c7-e63e-4b73-b4d2-31c412a8bcc8]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egiQsvFd {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egiQsvFd" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[de979a48-d150-4f93-b01e-f4aa92e31c83]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'egiQsvFd'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9b3fcc-9420-41ca-97a8-9979a6369c0c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6f5fef-3dc1-4619-808e-eb075314885f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:34 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:08:34 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:34 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:08:34 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d567705-7a8d-485d-ab73-06db37bbf67b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c, portal: 172.16.0.220,3260]
Nov 30 07:08:35 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c, portal: 172.16.0.220,3260] successful.
Nov 30 07:08:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f87846-31f3-40a0-af12-9c6573f6c6de]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdfd031-4b32-4316-9f00-5345b7f5e0fb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:35 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:08:35 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:08:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:35 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:08:35 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:08:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4495aa70-fd4f-4da8-a4b8-6cedcae3b173]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:08:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egiQsvFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] <== connect_volume: return (2156ms) {'type': 'block', 'scsi_wwn': '23861366336633061', 'path': '/dev/sdd'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861366336633061', 'path': '/dev/sdd'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.257s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:08:36 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:08:36 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a53105d-1e80-438f-aea0-130ac5f036ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:08:36 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNOSmAkq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:08:36 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be9808c-97cc-44e4-b488-95a60ea16846]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14] added
Nov 30 07:08:36 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60fa1ac-cbf9-41fb-be51-7ec07e44bca0]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2b3d50-4030-4116-91d5-e5a24794909f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tMedBsOp {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tMedBsOp" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4986855e-0156-4234-9c46-88484e89e3a7]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tMedBsOp'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f6e5ff-45a5-4572-98d5-7b4ecdd33b13]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec569e78-d473-4543-a01e-8b8b3c3eee5c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:36 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:08:36 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:08:36 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:36 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:08:36 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:08:36 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[726fc9a3-97c3-48f1-9784-f43e2fb246ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14, portal: 172.16.0.220,3260]
Nov 30 07:08:36 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14, portal: 172.16.0.220,3260] successful.
Nov 30 07:08:36 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0025b7-63b1-4b4a-b64e-aa5482def29b]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bff9c8-8ac8-4914-a26a-0d8805e58452]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:36 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:08:36 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:08:36 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:08:36 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:36 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:08:36 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:08:36 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:08:36 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0110e455-6c67-4881-8a95-6a82c50144fe]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:08:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMedBsOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] <== connect_volume: return (2556ms) {'type': 'block', 'scsi_wwn': '23361623864323263', 'path': '/dev/sde'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361623864323263', 'path': '/dev/sde'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.270s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:08:37 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:08:37 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1338ca65-cab6-4aa8-bf9d-89e97ae2dbb3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:08:37 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "address": "fa:16:3e:03:dc:1e", "network": {"id": "d6d10985-38b5-4e72-9276-76a246a2275e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1743986748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef61853-62", "ovs_interfaceid": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "address": "fa:16:3e:03:dc:1e", "network": {"id": "d6d10985-38b5-4e72-9276-76a246a2275e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1743986748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef61853-62", "ovs_interfaceid": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:dc:1e,bridge_name='br-int',has_traffic_filtering=True,id=5ef61853-620c-45df-9e8c-7ff595aecdf1,network=Network(d6d10985-38b5-4e72-9276-76a246a2275e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef61853-62') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "address": "fa:16:3e:5f:38:ec", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa8c23-b7", "ovs_interfaceid": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "address": "fa:16:3e:5f:38:ec", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa8c23-b7", "ovs_interfaceid": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:38:ec,bridge_name='br-int',has_traffic_filtering=True,id=e8aa8c23-b7b1-4fed-80e2-ab511875b253,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape8aa8c23-b7') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "address": "fa:16:3e:12:ac:0e", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d552b1b-e0", "ovs_interfaceid": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "address": "fa:16:3e:12:ac:0e", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d552b1b-e0", "ovs_interfaceid": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:ac:0e,bridge_name='br-int',has_traffic_filtering=True,id=3d552b1b-e03f-49a7-9f26-50748172b6d0,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d552b1b-e0') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "address": "fa:16:3e:a2:e2:22", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ac9e07-c0", "ovs_interfaceid": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "address": "fa:16:3e:a2:e2:22", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ac9e07-c0", "ovs_interfaceid": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e2:22,bridge_name='br-int',has_traffic_filtering=True,id=b9ac9e07-c027-4b26-ab1f-fe548b6a74a9,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ac9e07-c0') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "address": "fa:16:3e:d6:3f:bd", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab42e005-7e", "ovs_interfaceid": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "address": "fa:16:3e:d6:3f:bd", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab42e005-7e", "ovs_interfaceid": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:3f:bd,bridge_name='br-int',has_traffic_filtering=True,id=ab42e005-7e8c-4b45-a30b-c4f1c743b3a4,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab42e005-7e') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "address": "fa:16:3e:4b:ef:61", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa746d18c-57", "ovs_interfaceid": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "address": "fa:16:3e:4b:ef:61", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa746d18c-57", "ovs_interfaceid": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ef:61,bridge_name='br-int',has_traffic_filtering=True,id=a746d18c-574c-4c72-b3af-c5d7d6387f9c,network=Network(3c6d9467-49b6-456e-ac11-0c7286c2b773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa746d18c-57') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "177273b3-02d1-4f5c-ae31-70103280dd88", "address": "fa:16:3e:d3:53:db", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177273b3-02", "ovs_interfaceid": "177273b3-02d1-4f5c-ae31-70103280dd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "177273b3-02d1-4f5c-ae31-70103280dd88", "address": "fa:16:3e:d3:53:db", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177273b3-02", "ovs_interfaceid": "177273b3-02d1-4f5c-ae31-70103280dd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:53:db,bridge_name='br-int',has_traffic_filtering=True,id=177273b3-02d1-4f5c-ae31-70103280dd88,network=Network(3c6d9467-49b6-456e-ac11-0c7286c2b773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap177273b3-02') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.objects.instance [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lazy-loading 'pci_devices' on Instance uuid 09b63cd9-2f63-411d-886d-3ff237d145d0 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4a8def-7067-4514-83d0-dddacd588713]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89] added
Nov 30 07:08:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:08:37 user nova-compute[75293]:   <uuid>09b63cd9-2f63-411d-886d-3ff237d145d0</uuid>
Nov 30 07:08:37 user nova-compute[75293]:   <name>instance-0000000b</name>
Nov 30 07:08:37 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:08:37 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:08:37 user nova-compute[75293]:   <metadata>
Nov 30 07:08:37 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:08:37 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:08:37 user nova-compute[75293]:       <nova:name>tempest-device-tagging-server-174159183</nova:name>
Nov 30 07:08:37 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:08:32</nova:creationTime>
Nov 30 07:08:37 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:08:37 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:08:37 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:08:37 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:08:37 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:08:37 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:08:37 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:08:37 user nova-compute[75293]:       <nova:owner>
Nov 30 07:08:37 user nova-compute[75293]:         <nova:user uuid="413a648e1b45497d9663faef32ad1a13">tempest-TaggedBootDevicesTest-1519881645-project-member</nova:user>
Nov 30 07:08:37 user nova-compute[75293]:         <nova:project uuid="f62b7927ac1e441ca0897d81a5bb527e">tempest-TaggedBootDevicesTest-1519881645</nova:project>
Nov 30 07:08:37 user nova-compute[75293]:       </nova:owner>
Nov 30 07:08:37 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:08:37 user nova-compute[75293]:       <nova:ports>
Nov 30 07:08:37 user nova-compute[75293]:         <nova:port uuid="5ef61853-620c-45df-9e8c-7ff595aecdf1">
Nov 30 07:08:37 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 07:08:37 user nova-compute[75293]:         </nova:port>
Nov 30 07:08:37 user nova-compute[75293]:         <nova:port uuid="e8aa8c23-b7b1-4fed-80e2-ab511875b253">
Nov 30 07:08:37 user nova-compute[75293]:           <nova:ip type="fixed" address="10.1.1.238" ipVersion="4"/>
Nov 30 07:08:37 user nova-compute[75293]:         </nova:port>
Nov 30 07:08:37 user nova-compute[75293]:         <nova:port uuid="3d552b1b-e03f-49a7-9f26-50748172b6d0">
Nov 30 07:08:37 user nova-compute[75293]:           <nova:ip type="fixed" address="10.1.1.55" ipVersion="4"/>
Nov 30 07:08:37 user nova-compute[75293]:         </nova:port>
Nov 30 07:08:37 user nova-compute[75293]:         <nova:port uuid="b9ac9e07-c027-4b26-ab1f-fe548b6a74a9">
Nov 30 07:08:37 user nova-compute[75293]:           <nova:ip type="fixed" address="10.1.1.187" ipVersion="4"/>
Nov 30 07:08:37 user nova-compute[75293]:         </nova:port>
Nov 30 07:08:37 user nova-compute[75293]:         <nova:port uuid="ab42e005-7e8c-4b45-a30b-c4f1c743b3a4">
Nov 30 07:08:37 user nova-compute[75293]:           <nova:ip type="fixed" address="10.1.1.171" ipVersion="4"/>
Nov 30 07:08:37 user nova-compute[75293]:         </nova:port>
Nov 30 07:08:37 user nova-compute[75293]:         <nova:port uuid="a746d18c-574c-4c72-b3af-c5d7d6387f9c">
Nov 30 07:08:37 user nova-compute[75293]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 30 07:08:37 user nova-compute[75293]:         </nova:port>
Nov 30 07:08:37 user nova-compute[75293]:         <nova:port uuid="177273b3-02d1-4f5c-ae31-70103280dd88">
Nov 30 07:08:37 user nova-compute[75293]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 30 07:08:37 user nova-compute[75293]:         </nova:port>
Nov 30 07:08:37 user nova-compute[75293]:       </nova:ports>
Nov 30 07:08:37 user nova-compute[75293]:     </nova:instance>
Nov 30 07:08:37 user nova-compute[75293]:   </metadata>
Nov 30 07:08:37 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:08:37 user nova-compute[75293]:     <system>
Nov 30 07:08:37 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:08:37 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:08:37 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:08:37 user nova-compute[75293]:       <entry name="serial">09b63cd9-2f63-411d-886d-3ff237d145d0</entry>
Nov 30 07:08:37 user nova-compute[75293]:       <entry name="uuid">09b63cd9-2f63-411d-886d-3ff237d145d0</entry>
Nov 30 07:08:37 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:08:37 user nova-compute[75293]:     </system>
Nov 30 07:08:37 user nova-compute[75293]:   </sysinfo>
Nov 30 07:08:37 user nova-compute[75293]:   <os>
Nov 30 07:08:37 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:08:37 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:08:37 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:08:37 user nova-compute[75293]:   </os>
Nov 30 07:08:37 user nova-compute[75293]:   <features>
Nov 30 07:08:37 user nova-compute[75293]:     <acpi/>
Nov 30 07:08:37 user nova-compute[75293]:     <apic/>
Nov 30 07:08:37 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:08:37 user nova-compute[75293]:   </features>
Nov 30 07:08:37 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:08:37 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:08:37 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:08:37 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:08:37 user nova-compute[75293]:   </clock>
Nov 30 07:08:37 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:08:37 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:08:37 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:08:37 user nova-compute[75293]:   </cpu>
Nov 30 07:08:37 user nova-compute[75293]:   <devices>
Nov 30 07:08:37 user nova-compute[75293]:     <disk type="file" device="cdrom">
Nov 30 07:08:37 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none"/>
Nov 30 07:08:37 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/09b63cd9-2f63-411d-886d-3ff237d145d0/disk.config"/>
Nov 30 07:08:37 user nova-compute[75293]:       <target dev="hda" bus="ide"/>
Nov 30 07:08:37 user nova-compute[75293]:     </disk>
Nov 30 07:08:37 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:08:37 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:08:37 user nova-compute[75293]:       <source dev="/dev/sdb"/>
Nov 30 07:08:37 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:08:37 user nova-compute[75293]:       <serial>58d71501-6e63-4411-b9fc-c951d0c71f50</serial>
Nov 30 07:08:37 user nova-compute[75293]:     </disk>
Nov 30 07:08:37 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:08:37 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:08:37 user nova-compute[75293]:       <source dev="/dev/sdc"/>
Nov 30 07:08:37 user nova-compute[75293]:       <target dev="vdb" bus="virtio"/>
Nov 30 07:08:37 user nova-compute[75293]:       <serial>be5917ae-7628-4e29-a1af-dea190f86765</serial>
Nov 30 07:08:37 user nova-compute[75293]:     </disk>
Nov 30 07:08:37 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:08:37 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:08:37 user nova-compute[75293]:       <source dev="/dev/sde"/>
Nov 30 07:08:37 user nova-compute[75293]:       <target dev="vdc" bus="virtio"/>
Nov 30 07:08:37 user nova-compute[75293]:       <serial>178a4b07-0dd0-43e8-9303-99763655fc14</serial>
Nov 30 07:08:37 user nova-compute[75293]:     </disk>
Nov 30 07:08:37 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:08:37 user nova-compute[75293]:       <mac address="fa:16:3e:03:dc:1e"/>
Nov 30 07:08:37 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:08:37 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:08:37 user nova-compute[75293]:       <target dev="tap5ef61853-62"/>
Nov 30 07:08:37 user nova-compute[75293]:     </interface>
Nov 30 07:08:37 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:08:37 user nova-compute[75293]:       <mac address="fa:16:3e:5f:38:ec"/>
Nov 30 07:08:37 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:08:37 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:08:37 user nova-compute[75293]:       <target dev="tape8aa8c23-b7"/>
Nov 30 07:08:37 user nova-compute[75293]:     </interface>
Nov 30 07:08:37 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:08:37 user nova-compute[75293]:       <mac address="fa:16:3e:12:ac:0e"/>
Nov 30 07:08:37 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:08:37 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:08:37 user nova-compute[75293]:       <target dev="tap3d552b1b-e0"/>
Nov 30 07:08:37 user nova-compute[75293]:     </interface>
Nov 30 07:08:37 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:08:37 user nova-compute[75293]:       <mac address="fa:16:3e:a2:e2:22"/>
Nov 30 07:08:37 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:08:37 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:08:37 user nova-compute[75293]:       <target dev="tapb9ac9e07-c0"/>
Nov 30 07:08:37 user nova-compute[75293]:     </interface>
Nov 30 07:08:37 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:08:37 user nova-compute[75293]:       <mac address="fa:16:3e:d6:3f:bd"/>
Nov 30 07:08:37 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:08:37 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:08:37 user nova-compute[75293]:       <target dev="tapab42e005-7e"/>
Nov 30 07:08:37 user nova-compute[75293]:     </interface>
Nov 30 07:08:37 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:08:37 user nova-compute[75293]:       <mac address="fa:16:3e:4b:ef:61"/>
Nov 30 07:08:37 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:08:37 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:08:37 user nova-compute[75293]:       <target dev="tapa746d18c-57"/>
Nov 30 07:08:37 user nova-compute[75293]:     </interface>
Nov 30 07:08:37 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:08:37 user nova-compute[75293]:       <mac address="fa:16:3e:d3:53:db"/>
Nov 30 07:08:37 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:08:37 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:08:37 user nova-compute[75293]:       <target dev="tap177273b3-02"/>
Nov 30 07:08:37 user nova-compute[75293]:     </interface>
Nov 30 07:08:37 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:08:37 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/09b63cd9-2f63-411d-886d-3ff237d145d0/console.log" append="off"/>
Nov 30 07:08:37 user nova-compute[75293]:     </serial>
Nov 30 07:08:37 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:08:37 user nova-compute[75293]:     <video>
Nov 30 07:08:37 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:08:37 user nova-compute[75293]:     </video>
Nov 30 07:08:37 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:08:37 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:08:37 user nova-compute[75293]:     </rng>
Nov 30 07:08:37 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:08:37 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:08:37 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:08:37 user nova-compute[75293]:     </memballoon>
Nov 30 07:08:37 user nova-compute[75293]:   </devices>
Nov 30 07:08:37 user nova-compute[75293]: </domain>
Nov 30 07:08:37 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "address": "fa:16:3e:03:dc:1e", "network": {"id": "d6d10985-38b5-4e72-9276-76a246a2275e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1743986748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef61853-62", "ovs_interfaceid": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "address": "fa:16:3e:03:dc:1e", "network": {"id": "d6d10985-38b5-4e72-9276-76a246a2275e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1743986748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef61853-62", "ovs_interfaceid": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:dc:1e,bridge_name='br-int',has_traffic_filtering=True,id=5ef61853-620c-45df-9e8c-7ff595aecdf1,network=Network(d6d10985-38b5-4e72-9276-76a246a2275e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef61853-62') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:dc:1e,bridge_name='br-int',has_traffic_filtering=True,id=5ef61853-620c-45df-9e8c-7ff595aecdf1,network=Network(d6d10985-38b5-4e72-9276-76a246a2275e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef61853-62') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50f485e6-5358-5d47-8faf-f0f556581c5c', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2482f979-c51c-4354-8780-bd57f73a2a97]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ef61853-62, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ef61853-62, col_values=(('qos', UUID('cd1760d4-673d-4b69-9917-8eb26f78c920')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ef61853-62, col_values=(('external_ids', {'iface-id': '5ef61853-620c-45df-9e8c-7ff595aecdf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:dc:1e', 'vm-uuid': '09b63cd9-2f63-411d-886d-3ff237d145d0'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: INFO os_vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:dc:1e,bridge_name='br-int',has_traffic_filtering=True,id=5ef61853-620c-45df-9e8c-7ff595aecdf1,network=Network(d6d10985-38b5-4e72-9276-76a246a2275e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef61853-62')
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "address": "fa:16:3e:5f:38:ec", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa8c23-b7", "ovs_interfaceid": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "address": "fa:16:3e:5f:38:ec", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa8c23-b7", "ovs_interfaceid": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:38:ec,bridge_name='br-int',has_traffic_filtering=True,id=e8aa8c23-b7b1-4fed-80e2-ab511875b253,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape8aa8c23-b7') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:38:ec,bridge_name='br-int',has_traffic_filtering=True,id=e8aa8c23-b7b1-4fed-80e2-ab511875b253,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape8aa8c23-b7') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4049032-29b1-5d4e-a9bd-9e96e50d67d1', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7fcf0b-4910-47ad-a940-6b2f288e931f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xNOSmAkq {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8aa8c23-b7, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8aa8c23-b7, col_values=(('qos', UUID('ea79b8e9-f936-44ad-bf5a-8100df67e8de')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8aa8c23-b7, col_values=(('external_ids', {'iface-id': 'e8aa8c23-b7b1-4fed-80e2-ab511875b253', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:38:ec', 'vm-uuid': '09b63cd9-2f63-411d-886d-3ff237d145d0'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xNOSmAkq" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f7faf7-a814-4e90-8411-8cd066bddc91]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xNOSmAkq'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: INFO os_vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:38:ec,bridge_name='br-int',has_traffic_filtering=True,id=e8aa8c23-b7b1-4fed-80e2-ab511875b253,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape8aa8c23-b7')
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "address": "fa:16:3e:12:ac:0e", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d552b1b-e0", "ovs_interfaceid": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "address": "fa:16:3e:12:ac:0e", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d552b1b-e0", "ovs_interfaceid": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:ac:0e,bridge_name='br-int',has_traffic_filtering=True,id=3d552b1b-e03f-49a7-9f26-50748172b6d0,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d552b1b-e0') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:ac:0e,bridge_name='br-int',has_traffic_filtering=True,id=3d552b1b-e03f-49a7-9f26-50748172b6d0,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d552b1b-e0') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed74ef8d-3de0-4a25-a505-7e47f7849a9f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38df29ee-d211-557f-ab0d-9e9784204ed0', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d552b1b-e0, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d552b1b-e0, col_values=(('qos', UUID('cd4e7e9a-d72f-43c7-8983-8fd637d247fe')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d552b1b-e0, col_values=(('external_ids', {'iface-id': '3d552b1b-e03f-49a7-9f26-50748172b6d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:ac:0e', 'vm-uuid': '09b63cd9-2f63-411d-886d-3ff237d145d0'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d0eb2b-5393-44f6-9ded-c4bdf8202821]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:37 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:08:37 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:08:37 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:08:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:37 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:08:37 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:08:37 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:08:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: INFO os_vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:ac:0e,bridge_name='br-int',has_traffic_filtering=True,id=3d552b1b-e03f-49a7-9f26-50748172b6d0,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d552b1b-e0')
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "address": "fa:16:3e:a2:e2:22", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ac9e07-c0", "ovs_interfaceid": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "address": "fa:16:3e:a2:e2:22", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ac9e07-c0", "ovs_interfaceid": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e2:22,bridge_name='br-int',has_traffic_filtering=True,id=b9ac9e07-c027-4b26-ab1f-fe548b6a74a9,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ac9e07-c0') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e2:22,bridge_name='br-int',has_traffic_filtering=True,id=b9ac9e07-c027-4b26-ab1f-fe548b6a74a9,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ac9e07-c0') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4059c167-9668-5f86-a356-030222704d8d', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3dfad3-abbb-4016-931f-618369d8670b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89, portal: 172.16.0.220,3260]
Nov 30 07:08:37 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89, portal: 172.16.0.220,3260] successful.
Nov 30 07:08:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9ac9e07-c0, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9ac9e07-c0, col_values=(('qos', UUID('9d473c80-f271-40ee-b102-f19de0236b51')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9ac9e07-c0, col_values=(('external_ids', {'iface-id': 'b9ac9e07-c027-4b26-ab1f-fe548b6a74a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:e2:22', 'vm-uuid': '09b63cd9-2f63-411d-886d-3ff237d145d0'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cc550c-7dc7-4d7e-a336-997cd6d78f88]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: INFO os_vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e2:22,bridge_name='br-int',has_traffic_filtering=True,id=b9ac9e07-c027-4b26-ab1f-fe548b6a74a9,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ac9e07-c0')
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "address": "fa:16:3e:d6:3f:bd", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab42e005-7e", "ovs_interfaceid": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "address": "fa:16:3e:d6:3f:bd", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab42e005-7e", "ovs_interfaceid": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:3f:bd,bridge_name='br-int',has_traffic_filtering=True,id=ab42e005-7e8c-4b45-a30b-c4f1c743b3a4,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab42e005-7e') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:3f:bd,bridge_name='br-int',has_traffic_filtering=True,id=ab42e005-7e8c-4b45-a30b-c4f1c743b3a4,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab42e005-7e') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5693388e-69e4-5ed5-a880-13c0eb75b875', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[162f4b3f-6e22-4c28-9653-56e78732f0d0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:37 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:08:37 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:08:37 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:08:37 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:08:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:37 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:08:37 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:08:37 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:08:37 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:08:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e97f9c-136b-4f25-912a-21dff0e60c31]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNOSmAkq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab42e005-7e, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab42e005-7e, col_values=(('qos', UUID('c302ed45-3d01-4e17-a918-8b13a0861217')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab42e005-7e, col_values=(('external_ids', {'iface-id': 'ab42e005-7e8c-4b45-a30b-c4f1c743b3a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:3f:bd', 'vm-uuid': '09b63cd9-2f63-411d-886d-3ff237d145d0'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: INFO os_vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:3f:bd,bridge_name='br-int',has_traffic_filtering=True,id=ab42e005-7e8c-4b45-a30b-c4f1c743b3a4,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab42e005-7e')
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "address": "fa:16:3e:4b:ef:61", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa746d18c-57", "ovs_interfaceid": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "address": "fa:16:3e:4b:ef:61", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa746d18c-57", "ovs_interfaceid": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ef:61,bridge_name='br-int',has_traffic_filtering=True,id=a746d18c-574c-4c72-b3af-c5d7d6387f9c,network=Network(3c6d9467-49b6-456e-ac11-0c7286c2b773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa746d18c-57') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ef:61,bridge_name='br-int',has_traffic_filtering=True,id=a746d18c-574c-4c72-b3af-c5d7d6387f9c,network=Network(3c6d9467-49b6-456e-ac11-0c7286c2b773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa746d18c-57') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3a594bf-1ed6-5f15-8eb1-c81c36a81c48', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa746d18c-57, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa746d18c-57, col_values=(('qos', UUID('b0bd4378-84a0-4ef4-9d9a-0cf0e837b57f')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa746d18c-57, col_values=(('external_ids', {'iface-id': 'a746d18c-574c-4c72-b3af-c5d7d6387f9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:ef:61', 'vm-uuid': '09b63cd9-2f63-411d-886d-3ff237d145d0'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: INFO os_vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ef:61,bridge_name='br-int',has_traffic_filtering=True,id=a746d18c-574c-4c72-b3af-c5d7d6387f9c,network=Network(3c6d9467-49b6-456e-ac11-0c7286c2b773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa746d18c-57')
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "177273b3-02d1-4f5c-ae31-70103280dd88", "address": "fa:16:3e:d3:53:db", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177273b3-02", "ovs_interfaceid": "177273b3-02d1-4f5c-ae31-70103280dd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "177273b3-02d1-4f5c-ae31-70103280dd88", "address": "fa:16:3e:d3:53:db", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177273b3-02", "ovs_interfaceid": "177273b3-02d1-4f5c-ae31-70103280dd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:53:db,bridge_name='br-int',has_traffic_filtering=True,id=177273b3-02d1-4f5c-ae31-70103280dd88,network=Network(3c6d9467-49b6-456e-ac11-0c7286c2b773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap177273b3-02') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG os_vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:53:db,bridge_name='br-int',has_traffic_filtering=True,id=177273b3-02d1-4f5c-ae31-70103280dd88,network=Network(3c6d9467-49b6-456e-ac11-0c7286c2b773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap177273b3-02') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '199cdb42-4a8c-552c-a862-6b06e25957d4', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap177273b3-02, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap177273b3-02, col_values=(('qos', UUID('1d8d9329-65c5-4819-ab92-19eff1606b6b')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap177273b3-02, col_values=(('external_ids', {'iface-id': '177273b3-02d1-4f5c-ae31-70103280dd88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:53:db', 'vm-uuid': '09b63cd9-2f63-411d-886d-3ff237d145d0'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:38 user nova-compute[75293]: INFO os_vif [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:53:db,bridge_name='br-int',has_traffic_filtering=True,id=177273b3-02d1-4f5c-ae31-70103280dd88,network=Network(3c6d9467-49b6-456e-ac11-0c7286c2b773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap177273b3-02')
Nov 30 07:08:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] No BDM found with device name hda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] No VIF found with MAC fa:16:3e:03:dc:1e, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] No VIF found with MAC fa:16:3e:d6:3f:bd, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:08:38 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Using config drive
Nov 30 07:08:38 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Creating config drive at /opt/stack/data/nova/instances/09b63cd9-2f63-411d-886d-3ff237d145d0/disk.config
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/09b63cd9-2f63-411d-886d-3ff237d145d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpt77jv7q8 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/09b63cd9-2f63-411d-886d-3ff237d145d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpt77jv7q8" returned: 0 in 0.146s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] <== connect_volume: return (2619ms) {'type': 'block', 'scsi_wwn': '23061383266616662', 'path': '/dev/sdf'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061383266616662', 'path': '/dev/sdf'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEqsjIOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:08:38 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:08:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:08:38 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:08:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:08:38 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0d2a1c-c0e7-475a-a912-d03031a2791a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:08:38 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9d11f6-de3d-4456-a660-d3a20ff75e1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51] added
Nov 30 07:08:38 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5064bf00-9c71-4a97-a135-ed71ee080cb4]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c273b3b6-f474-4daa-80e2-14d86d5c8d5a]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CEqsjIOe {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CEqsjIOe" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[52df097e-bf72-4001-b865-7f3d0705ce25]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CEqsjIOe'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cb9d7e-447c-4bb8-9f8d-1ad12e4ced4a]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7f8ea1-3a77-4b9e-a543-96a3d3af7e9a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:38 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:08:38 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:08:38 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:08:38 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:08:38 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:38 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:08:38 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:08:38 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:08:38 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:08:38 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:08:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8b8d41-4da6-42a7-ba9c-5f14b6a15abb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51, portal: 172.16.0.220,3260]
Nov 30 07:08:39 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51, portal: 172.16.0.220,3260] successful.
Nov 30 07:08:39 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ee3619-dbc6-4a83-a754-c56b466e1f61]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a6dfea-b23d-4de3-84e2-37edb27a8022]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:39 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:08:39 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:08:39 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:08:39 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:08:39 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:08:39 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:08:39 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:08:39 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:08:39 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:08:39 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:08:39 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:08:39 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3cdedb-2529-4bd3-b035-dc8987987ad4]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:08:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEqsjIOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23662663637363133', 'path': '/dev/sdg'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662663637363133', 'path': '/dev/sdg'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "address": "fa:16:3e:45:27:91", "network": {"id": "dcc0a646-3097-4d7c-8d41-a5cd415c9ec3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1268388523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb623d7c-b0", "ovs_interfaceid": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "address": "fa:16:3e:45:27:91", "network": {"id": "dcc0a646-3097-4d7c-8d41-a5cd415c9ec3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1268388523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb623d7c-b0", "ovs_interfaceid": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:27:91,bridge_name='br-int',has_traffic_filtering=True,id=fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6,network=Network(dcc0a646-3097-4d7c-8d41-a5cd415c9ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb623d7c-b0') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60e4fab9-df41-42dd-be40-1300f77a7d89", "address": "fa:16:3e:01:72:2a", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e4fab9-df", "ovs_interfaceid": "60e4fab9-df41-42dd-be40-1300f77a7d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "60e4fab9-df41-42dd-be40-1300f77a7d89", "address": "fa:16:3e:01:72:2a", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e4fab9-df", "ovs_interfaceid": "60e4fab9-df41-42dd-be40-1300f77a7d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:72:2a,bridge_name='br-int',has_traffic_filtering=True,id=60e4fab9-df41-42dd-be40-1300f77a7d89,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60e4fab9-df') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b998882b-1d11-404b-930e-91b355ded504", "address": "fa:16:3e:82:f1:9d", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb998882b-1d", "ovs_interfaceid": "b998882b-1d11-404b-930e-91b355ded504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "b998882b-1d11-404b-930e-91b355ded504", "address": "fa:16:3e:82:f1:9d", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb998882b-1d", "ovs_interfaceid": "b998882b-1d11-404b-930e-91b355ded504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=b998882b-1d11-404b-930e-91b355ded504,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb998882b-1d') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b73c69b2-9f21-4615-80a4-7676df8071bd", "address": "fa:16:3e:28:00:25", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73c69b2-9f", "ovs_interfaceid": "b73c69b2-9f21-4615-80a4-7676df8071bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "b73c69b2-9f21-4615-80a4-7676df8071bd", "address": "fa:16:3e:28:00:25", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73c69b2-9f", "ovs_interfaceid": "b73c69b2-9f21-4615-80a4-7676df8071bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:00:25,bridge_name='br-int',has_traffic_filtering=True,id=b73c69b2-9f21-4615-80a4-7676df8071bd,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73c69b2-9f') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "address": "fa:16:3e:c2:fb:c4", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666a23fb-99", "ovs_interfaceid": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "address": "fa:16:3e:c2:fb:c4", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666a23fb-99", "ovs_interfaceid": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:fb:c4,bridge_name='br-int',has_traffic_filtering=True,id=666a23fb-99db-4762-9181-18e0fbbbfdf2,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666a23fb-99') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbb92875-8448-4085-8275-c9cb21d80edf", "address": "fa:16:3e:a5:35:29", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb92875-84", "ovs_interfaceid": "dbb92875-8448-4085-8275-c9cb21d80edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "dbb92875-8448-4085-8275-c9cb21d80edf", "address": "fa:16:3e:a5:35:29", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb92875-84", "ovs_interfaceid": "dbb92875-8448-4085-8275-c9cb21d80edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:35:29,bridge_name='br-int',has_traffic_filtering=True,id=dbb92875-8448-4085-8275-c9cb21d80edf,network=Network(648a2400-b581-4a51-a2f6-df676910ceee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb92875-84') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09043b02-fceb-424b-9f68-a526293780c2", "address": "fa:16:3e:82:90:d6", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09043b02-fc", "ovs_interfaceid": "09043b02-fceb-424b-9f68-a526293780c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "09043b02-fceb-424b-9f68-a526293780c2", "address": "fa:16:3e:82:90:d6", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09043b02-fc", "ovs_interfaceid": "09043b02-fceb-424b-9f68-a526293780c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:90:d6,bridge_name='br-int',has_traffic_filtering=True,id=09043b02-fceb-424b-9f68-a526293780c2,network=Network(648a2400-b581-4a51-a2f6-df676910ceee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09043b02-fc') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.objects.instance [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lazy-loading 'pci_devices' on Instance uuid cc583d29-3df4-4406-b5a5-f4b3d300fabb {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:08:40 user nova-compute[75293]:   <uuid>cc583d29-3df4-4406-b5a5-f4b3d300fabb</uuid>
Nov 30 07:08:40 user nova-compute[75293]:   <name>instance-0000000c</name>
Nov 30 07:08:40 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:08:40 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:08:40 user nova-compute[75293]:   <metadata>
Nov 30 07:08:40 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:08:40 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:08:40 user nova-compute[75293]:       <nova:name>tempest-device-tagging-server-1359238201</nova:name>
Nov 30 07:08:40 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:08:33</nova:creationTime>
Nov 30 07:08:40 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:08:40 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:08:40 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:08:40 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:08:40 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:08:40 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:08:40 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:08:40 user nova-compute[75293]:       <nova:owner>
Nov 30 07:08:40 user nova-compute[75293]:         <nova:user uuid="7754783efd654868ab533fc179a7a485">tempest-TaggedBootDevicesTest_v242-1204410285-project-member</nova:user>
Nov 30 07:08:40 user nova-compute[75293]:         <nova:project uuid="d0b4aec4e9794fa1bedce064018cc3a4">tempest-TaggedBootDevicesTest_v242-1204410285</nova:project>
Nov 30 07:08:40 user nova-compute[75293]:       </nova:owner>
Nov 30 07:08:40 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:08:40 user nova-compute[75293]:       <nova:ports>
Nov 30 07:08:40 user nova-compute[75293]:         <nova:port uuid="fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6">
Nov 30 07:08:40 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 07:08:40 user nova-compute[75293]:         </nova:port>
Nov 30 07:08:40 user nova-compute[75293]:         <nova:port uuid="60e4fab9-df41-42dd-be40-1300f77a7d89">
Nov 30 07:08:40 user nova-compute[75293]:           <nova:ip type="fixed" address="10.1.1.34" ipVersion="4"/>
Nov 30 07:08:40 user nova-compute[75293]:         </nova:port>
Nov 30 07:08:40 user nova-compute[75293]:         <nova:port uuid="b998882b-1d11-404b-930e-91b355ded504">
Nov 30 07:08:40 user nova-compute[75293]:           <nova:ip type="fixed" address="10.1.1.156" ipVersion="4"/>
Nov 30 07:08:40 user nova-compute[75293]:         </nova:port>
Nov 30 07:08:40 user nova-compute[75293]:         <nova:port uuid="b73c69b2-9f21-4615-80a4-7676df8071bd">
Nov 30 07:08:40 user nova-compute[75293]:           <nova:ip type="fixed" address="10.1.1.96" ipVersion="4"/>
Nov 30 07:08:40 user nova-compute[75293]:         </nova:port>
Nov 30 07:08:40 user nova-compute[75293]:         <nova:port uuid="666a23fb-99db-4762-9181-18e0fbbbfdf2">
Nov 30 07:08:40 user nova-compute[75293]:           <nova:ip type="fixed" address="10.1.1.203" ipVersion="4"/>
Nov 30 07:08:40 user nova-compute[75293]:         </nova:port>
Nov 30 07:08:40 user nova-compute[75293]:         <nova:port uuid="dbb92875-8448-4085-8275-c9cb21d80edf">
Nov 30 07:08:40 user nova-compute[75293]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 30 07:08:40 user nova-compute[75293]:         </nova:port>
Nov 30 07:08:40 user nova-compute[75293]:         <nova:port uuid="09043b02-fceb-424b-9f68-a526293780c2">
Nov 30 07:08:40 user nova-compute[75293]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 30 07:08:40 user nova-compute[75293]:         </nova:port>
Nov 30 07:08:40 user nova-compute[75293]:       </nova:ports>
Nov 30 07:08:40 user nova-compute[75293]:     </nova:instance>
Nov 30 07:08:40 user nova-compute[75293]:   </metadata>
Nov 30 07:08:40 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:08:40 user nova-compute[75293]:     <system>
Nov 30 07:08:40 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:08:40 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:08:40 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:08:40 user nova-compute[75293]:       <entry name="serial">cc583d29-3df4-4406-b5a5-f4b3d300fabb</entry>
Nov 30 07:08:40 user nova-compute[75293]:       <entry name="uuid">cc583d29-3df4-4406-b5a5-f4b3d300fabb</entry>
Nov 30 07:08:40 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:08:40 user nova-compute[75293]:     </system>
Nov 30 07:08:40 user nova-compute[75293]:   </sysinfo>
Nov 30 07:08:40 user nova-compute[75293]:   <os>
Nov 30 07:08:40 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:08:40 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:08:40 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:08:40 user nova-compute[75293]:   </os>
Nov 30 07:08:40 user nova-compute[75293]:   <features>
Nov 30 07:08:40 user nova-compute[75293]:     <acpi/>
Nov 30 07:08:40 user nova-compute[75293]:     <apic/>
Nov 30 07:08:40 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:08:40 user nova-compute[75293]:   </features>
Nov 30 07:08:40 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:08:40 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:08:40 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:08:40 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:08:40 user nova-compute[75293]:   </clock>
Nov 30 07:08:40 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:08:40 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:08:40 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:08:40 user nova-compute[75293]:   </cpu>
Nov 30 07:08:40 user nova-compute[75293]:   <devices>
Nov 30 07:08:40 user nova-compute[75293]:     <disk type="file" device="cdrom">
Nov 30 07:08:40 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none"/>
Nov 30 07:08:40 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/cc583d29-3df4-4406-b5a5-f4b3d300fabb/disk.config"/>
Nov 30 07:08:40 user nova-compute[75293]:       <target dev="hda" bus="ide"/>
Nov 30 07:08:40 user nova-compute[75293]:     </disk>
Nov 30 07:08:40 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:08:40 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:08:40 user nova-compute[75293]:       <source dev="/dev/sdd"/>
Nov 30 07:08:40 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:08:40 user nova-compute[75293]:       <serial>d46660fa-08d4-4b31-b4ca-3866a550c88c</serial>
Nov 30 07:08:40 user nova-compute[75293]:     </disk>
Nov 30 07:08:40 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:08:40 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:08:40 user nova-compute[75293]:       <source dev="/dev/sdf"/>
Nov 30 07:08:40 user nova-compute[75293]:       <target dev="vdb" bus="virtio"/>
Nov 30 07:08:40 user nova-compute[75293]:       <serial>f80c421f-f8ec-4cc7-86ee-59ef34a74c89</serial>
Nov 30 07:08:40 user nova-compute[75293]:     </disk>
Nov 30 07:08:40 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:08:40 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:08:40 user nova-compute[75293]:       <source dev="/dev/sdg"/>
Nov 30 07:08:40 user nova-compute[75293]:       <target dev="vdc" bus="virtio"/>
Nov 30 07:08:40 user nova-compute[75293]:       <serial>bb80b1dd-cfed-46f4-a524-f66fda55bf51</serial>
Nov 30 07:08:40 user nova-compute[75293]:     </disk>
Nov 30 07:08:40 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:08:40 user nova-compute[75293]:       <mac address="fa:16:3e:45:27:91"/>
Nov 30 07:08:40 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:08:40 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:08:40 user nova-compute[75293]:       <target dev="tapfb623d7c-b0"/>
Nov 30 07:08:40 user nova-compute[75293]:     </interface>
Nov 30 07:08:40 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:08:40 user nova-compute[75293]:       <mac address="fa:16:3e:01:72:2a"/>
Nov 30 07:08:40 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:08:40 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:08:40 user nova-compute[75293]:       <target dev="tap60e4fab9-df"/>
Nov 30 07:08:40 user nova-compute[75293]:     </interface>
Nov 30 07:08:40 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:08:40 user nova-compute[75293]:       <mac address="fa:16:3e:82:f1:9d"/>
Nov 30 07:08:40 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:08:40 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:08:40 user nova-compute[75293]:       <target dev="tapb998882b-1d"/>
Nov 30 07:08:40 user nova-compute[75293]:     </interface>
Nov 30 07:08:40 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:08:40 user nova-compute[75293]:       <mac address="fa:16:3e:28:00:25"/>
Nov 30 07:08:40 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:08:40 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:08:40 user nova-compute[75293]:       <target dev="tapb73c69b2-9f"/>
Nov 30 07:08:40 user nova-compute[75293]:     </interface>
Nov 30 07:08:40 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:08:40 user nova-compute[75293]:       <mac address="fa:16:3e:c2:fb:c4"/>
Nov 30 07:08:40 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:08:40 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:08:40 user nova-compute[75293]:       <target dev="tap666a23fb-99"/>
Nov 30 07:08:40 user nova-compute[75293]:     </interface>
Nov 30 07:08:40 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:08:40 user nova-compute[75293]:       <mac address="fa:16:3e:a5:35:29"/>
Nov 30 07:08:40 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:08:40 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:08:40 user nova-compute[75293]:       <target dev="tapdbb92875-84"/>
Nov 30 07:08:40 user nova-compute[75293]:     </interface>
Nov 30 07:08:40 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:08:40 user nova-compute[75293]:       <mac address="fa:16:3e:82:90:d6"/>
Nov 30 07:08:40 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:08:40 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:08:40 user nova-compute[75293]:       <target dev="tap09043b02-fc"/>
Nov 30 07:08:40 user nova-compute[75293]:     </interface>
Nov 30 07:08:40 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:08:40 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/cc583d29-3df4-4406-b5a5-f4b3d300fabb/console.log" append="off"/>
Nov 30 07:08:40 user nova-compute[75293]:     </serial>
Nov 30 07:08:40 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:08:40 user nova-compute[75293]:     <video>
Nov 30 07:08:40 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:08:40 user nova-compute[75293]:     </video>
Nov 30 07:08:40 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:08:40 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:08:40 user nova-compute[75293]:     </rng>
Nov 30 07:08:40 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:08:40 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:08:40 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:08:40 user nova-compute[75293]:     </memballoon>
Nov 30 07:08:40 user nova-compute[75293]:   </devices>
Nov 30 07:08:40 user nova-compute[75293]: </domain>
Nov 30 07:08:40 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "address": "fa:16:3e:45:27:91", "network": {"id": "dcc0a646-3097-4d7c-8d41-a5cd415c9ec3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1268388523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb623d7c-b0", "ovs_interfaceid": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "address": "fa:16:3e:45:27:91", "network": {"id": "dcc0a646-3097-4d7c-8d41-a5cd415c9ec3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1268388523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb623d7c-b0", "ovs_interfaceid": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:27:91,bridge_name='br-int',has_traffic_filtering=True,id=fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6,network=Network(dcc0a646-3097-4d7c-8d41-a5cd415c9ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb623d7c-b0') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG os_vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:27:91,bridge_name='br-int',has_traffic_filtering=True,id=fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6,network=Network(dcc0a646-3097-4d7c-8d41-a5cd415c9ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb623d7c-b0') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d7b9d7c-09dc-5294-9775-80ab1576aa34', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb623d7c-b0, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb623d7c-b0, col_values=(('qos', UUID('2df649b5-1e88-490d-8a54-5c5fc4654842')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb623d7c-b0, col_values=(('external_ids', {'iface-id': 'fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:27:91', 'vm-uuid': 'cc583d29-3df4-4406-b5a5-f4b3d300fabb'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:40 user nova-compute[75293]: INFO os_vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:27:91,bridge_name='br-int',has_traffic_filtering=True,id=fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6,network=Network(dcc0a646-3097-4d7c-8d41-a5cd415c9ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb623d7c-b0')
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60e4fab9-df41-42dd-be40-1300f77a7d89", "address": "fa:16:3e:01:72:2a", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e4fab9-df", "ovs_interfaceid": "60e4fab9-df41-42dd-be40-1300f77a7d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "60e4fab9-df41-42dd-be40-1300f77a7d89", "address": "fa:16:3e:01:72:2a", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e4fab9-df", "ovs_interfaceid": "60e4fab9-df41-42dd-be40-1300f77a7d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:72:2a,bridge_name='br-int',has_traffic_filtering=True,id=60e4fab9-df41-42dd-be40-1300f77a7d89,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60e4fab9-df') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG os_vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:72:2a,bridge_name='br-int',has_traffic_filtering=True,id=60e4fab9-df41-42dd-be40-1300f77a7d89,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60e4fab9-df') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1cc868c-1516-5763-bf97-693a56b8f404', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.compute.manager [req-9bfe90fe-6c95-4035-90f5-ece3a123420c req-6015de91-b660-4848-90f4-b2bbe94dde6b service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-5ef61853-620c-45df-9e8c-7ff595aecdf1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9bfe90fe-6c95-4035-90f5-ece3a123420c req-6015de91-b660-4848-90f4-b2bbe94dde6b service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9bfe90fe-6c95-4035-90f5-ece3a123420c req-6015de91-b660-4848-90f4-b2bbe94dde6b service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9bfe90fe-6c95-4035-90f5-ece3a123420c req-6015de91-b660-4848-90f4-b2bbe94dde6b service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG nova.compute.manager [req-9bfe90fe-6c95-4035-90f5-ece3a123420c req-6015de91-b660-4848-90f4-b2bbe94dde6b service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-5ef61853-620c-45df-9e8c-7ff595aecdf1 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:40 user nova-compute[75293]: WARNING nova.compute.manager [req-9bfe90fe-6c95-4035-90f5-ece3a123420c req-6015de91-b660-4848-90f4-b2bbe94dde6b service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-5ef61853-620c-45df-9e8c-7ff595aecdf1 for instance with vm_state building and task_state spawning.
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60e4fab9-df, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60e4fab9-df, col_values=(('qos', UUID('9c4dbe6b-743e-48c0-9980-08b9b3e3f164')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60e4fab9-df, col_values=(('external_ids', {'iface-id': '60e4fab9-df41-42dd-be40-1300f77a7d89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:72:2a', 'vm-uuid': 'cc583d29-3df4-4406-b5a5-f4b3d300fabb'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: INFO os_vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:72:2a,bridge_name='br-int',has_traffic_filtering=True,id=60e4fab9-df41-42dd-be40-1300f77a7d89,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60e4fab9-df')
Nov 30 07:08:41 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b998882b-1d11-404b-930e-91b355ded504", "address": "fa:16:3e:82:f1:9d", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb998882b-1d", "ovs_interfaceid": "b998882b-1d11-404b-930e-91b355ded504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "b998882b-1d11-404b-930e-91b355ded504", "address": "fa:16:3e:82:f1:9d", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb998882b-1d", "ovs_interfaceid": "b998882b-1d11-404b-930e-91b355ded504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=b998882b-1d11-404b-930e-91b355ded504,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb998882b-1d') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG os_vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=b998882b-1d11-404b-930e-91b355ded504,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb998882b-1d') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cde7b9ad-2105-5bc7-b915-bd3c924c8ff0', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb998882b-1d, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb998882b-1d, col_values=(('qos', UUID('982dd283-6867-454f-bb4b-89f98a3b5338')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb998882b-1d, col_values=(('external_ids', {'iface-id': 'b998882b-1d11-404b-930e-91b355ded504', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:f1:9d', 'vm-uuid': 'cc583d29-3df4-4406-b5a5-f4b3d300fabb'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG nova.compute.manager [req-62448b6d-3541-4b6a-9540-0212a49c4e41 req-41e0e3df-0d63-42f5-999f-af7077fe00e5 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-e8aa8c23-b7b1-4fed-80e2-ab511875b253 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-62448b6d-3541-4b6a-9540-0212a49c4e41 req-41e0e3df-0d63-42f5-999f-af7077fe00e5 service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-62448b6d-3541-4b6a-9540-0212a49c4e41 req-41e0e3df-0d63-42f5-999f-af7077fe00e5 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-62448b6d-3541-4b6a-9540-0212a49c4e41 req-41e0e3df-0d63-42f5-999f-af7077fe00e5 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG nova.compute.manager [req-62448b6d-3541-4b6a-9540-0212a49c4e41 req-41e0e3df-0d63-42f5-999f-af7077fe00e5 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-e8aa8c23-b7b1-4fed-80e2-ab511875b253 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:41 user nova-compute[75293]: WARNING nova.compute.manager [req-62448b6d-3541-4b6a-9540-0212a49c4e41 req-41e0e3df-0d63-42f5-999f-af7077fe00e5 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-e8aa8c23-b7b1-4fed-80e2-ab511875b253 for instance with vm_state building and task_state spawning.
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: INFO os_vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=b998882b-1d11-404b-930e-91b355ded504,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb998882b-1d')
Nov 30 07:08:41 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b73c69b2-9f21-4615-80a4-7676df8071bd", "address": "fa:16:3e:28:00:25", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73c69b2-9f", "ovs_interfaceid": "b73c69b2-9f21-4615-80a4-7676df8071bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "b73c69b2-9f21-4615-80a4-7676df8071bd", "address": "fa:16:3e:28:00:25", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73c69b2-9f", "ovs_interfaceid": "b73c69b2-9f21-4615-80a4-7676df8071bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:00:25,bridge_name='br-int',has_traffic_filtering=True,id=b73c69b2-9f21-4615-80a4-7676df8071bd,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73c69b2-9f') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG os_vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:00:25,bridge_name='br-int',has_traffic_filtering=True,id=b73c69b2-9f21-4615-80a4-7676df8071bd,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73c69b2-9f') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa1eceb5-0867-54d8-a776-42c35a1b4d7d', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb73c69b2-9f, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb73c69b2-9f, col_values=(('qos', UUID('85ff6286-47e0-4249-94c7-2ce091113950')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb73c69b2-9f, col_values=(('external_ids', {'iface-id': 'b73c69b2-9f21-4615-80a4-7676df8071bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:00:25', 'vm-uuid': 'cc583d29-3df4-4406-b5a5-f4b3d300fabb'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: INFO os_vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:00:25,bridge_name='br-int',has_traffic_filtering=True,id=b73c69b2-9f21-4615-80a4-7676df8071bd,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73c69b2-9f')
Nov 30 07:08:41 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "address": "fa:16:3e:c2:fb:c4", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666a23fb-99", "ovs_interfaceid": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "address": "fa:16:3e:c2:fb:c4", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666a23fb-99", "ovs_interfaceid": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:fb:c4,bridge_name='br-int',has_traffic_filtering=True,id=666a23fb-99db-4762-9181-18e0fbbbfdf2,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666a23fb-99') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG os_vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:fb:c4,bridge_name='br-int',has_traffic_filtering=True,id=666a23fb-99db-4762-9181-18e0fbbbfdf2,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666a23fb-99') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd3a26e4-f1b3-5a53-9e70-9c186cfaa9e4', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap666a23fb-99, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap666a23fb-99, col_values=(('qos', UUID('43c77f58-cf81-4f16-b902-4c4965d6f0df')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap666a23fb-99, col_values=(('external_ids', {'iface-id': '666a23fb-99db-4762-9181-18e0fbbbfdf2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:fb:c4', 'vm-uuid': 'cc583d29-3df4-4406-b5a5-f4b3d300fabb'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG nova.compute.manager [req-2d9524a5-a769-47b5-880e-685f5a0b50d5 req-4dc6ac8d-fd0d-406b-b2ba-ea7600eb6e90 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-b9ac9e07-c027-4b26-ab1f-fe548b6a74a9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2d9524a5-a769-47b5-880e-685f5a0b50d5 req-4dc6ac8d-fd0d-406b-b2ba-ea7600eb6e90 service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2d9524a5-a769-47b5-880e-685f5a0b50d5 req-4dc6ac8d-fd0d-406b-b2ba-ea7600eb6e90 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2d9524a5-a769-47b5-880e-685f5a0b50d5 req-4dc6ac8d-fd0d-406b-b2ba-ea7600eb6e90 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG nova.compute.manager [req-2d9524a5-a769-47b5-880e-685f5a0b50d5 req-4dc6ac8d-fd0d-406b-b2ba-ea7600eb6e90 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-b9ac9e07-c027-4b26-ab1f-fe548b6a74a9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:42 user nova-compute[75293]: WARNING nova.compute.manager [req-2d9524a5-a769-47b5-880e-685f5a0b50d5 req-4dc6ac8d-fd0d-406b-b2ba-ea7600eb6e90 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-b9ac9e07-c027-4b26-ab1f-fe548b6a74a9 for instance with vm_state building and task_state spawning.
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: INFO os_vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:fb:c4,bridge_name='br-int',has_traffic_filtering=True,id=666a23fb-99db-4762-9181-18e0fbbbfdf2,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666a23fb-99')
Nov 30 07:08:42 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbb92875-8448-4085-8275-c9cb21d80edf", "address": "fa:16:3e:a5:35:29", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb92875-84", "ovs_interfaceid": "dbb92875-8448-4085-8275-c9cb21d80edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "dbb92875-8448-4085-8275-c9cb21d80edf", "address": "fa:16:3e:a5:35:29", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb92875-84", "ovs_interfaceid": "dbb92875-8448-4085-8275-c9cb21d80edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:35:29,bridge_name='br-int',has_traffic_filtering=True,id=dbb92875-8448-4085-8275-c9cb21d80edf,network=Network(648a2400-b581-4a51-a2f6-df676910ceee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb92875-84') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG os_vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:35:29,bridge_name='br-int',has_traffic_filtering=True,id=dbb92875-8448-4085-8275-c9cb21d80edf,network=Network(648a2400-b581-4a51-a2f6-df676910ceee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb92875-84') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '056491cf-2f78-5157-a4c2-c8a2bd910baf', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbb92875-84, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbb92875-84, col_values=(('qos', UUID('38e0aeeb-3ca2-4a65-9ef2-6b0681b10295')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbb92875-84, col_values=(('external_ids', {'iface-id': 'dbb92875-8448-4085-8275-c9cb21d80edf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:35:29', 'vm-uuid': 'cc583d29-3df4-4406-b5a5-f4b3d300fabb'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: INFO os_vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:35:29,bridge_name='br-int',has_traffic_filtering=True,id=dbb92875-8448-4085-8275-c9cb21d80edf,network=Network(648a2400-b581-4a51-a2f6-df676910ceee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb92875-84')
Nov 30 07:08:42 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09043b02-fceb-424b-9f68-a526293780c2", "address": "fa:16:3e:82:90:d6", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09043b02-fc", "ovs_interfaceid": "09043b02-fceb-424b-9f68-a526293780c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "09043b02-fceb-424b-9f68-a526293780c2", "address": "fa:16:3e:82:90:d6", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09043b02-fc", "ovs_interfaceid": "09043b02-fceb-424b-9f68-a526293780c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:90:d6,bridge_name='br-int',has_traffic_filtering=True,id=09043b02-fceb-424b-9f68-a526293780c2,network=Network(648a2400-b581-4a51-a2f6-df676910ceee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09043b02-fc') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG os_vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:90:d6,bridge_name='br-int',has_traffic_filtering=True,id=09043b02-fceb-424b-9f68-a526293780c2,network=Network(648a2400-b581-4a51-a2f6-df676910ceee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09043b02-fc') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48b8cc37-1afb-5f05-9ccb-7b8f4b474696', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09043b02-fc, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09043b02-fc, col_values=(('qos', UUID('da1e1ece-68e3-4df6-a8ea-cb19f0ab310a')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09043b02-fc, col_values=(('external_ids', {'iface-id': '09043b02-fceb-424b-9f68-a526293780c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:90:d6', 'vm-uuid': 'cc583d29-3df4-4406-b5a5-f4b3d300fabb'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG nova.compute.manager [req-628a0453-70b0-49ae-a4db-2783d5bf13d2 req-80e3c35e-b96b-4780-90ef-d450636b8451 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-5ef61853-620c-45df-9e8c-7ff595aecdf1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-628a0453-70b0-49ae-a4db-2783d5bf13d2 req-80e3c35e-b96b-4780-90ef-d450636b8451 service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-628a0453-70b0-49ae-a4db-2783d5bf13d2 req-80e3c35e-b96b-4780-90ef-d450636b8451 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-628a0453-70b0-49ae-a4db-2783d5bf13d2 req-80e3c35e-b96b-4780-90ef-d450636b8451 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG nova.compute.manager [req-628a0453-70b0-49ae-a4db-2783d5bf13d2 req-80e3c35e-b96b-4780-90ef-d450636b8451 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-5ef61853-620c-45df-9e8c-7ff595aecdf1 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:42 user nova-compute[75293]: WARNING nova.compute.manager [req-628a0453-70b0-49ae-a4db-2783d5bf13d2 req-80e3c35e-b96b-4780-90ef-d450636b8451 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-5ef61853-620c-45df-9e8c-7ff595aecdf1 for instance with vm_state building and task_state spawning.
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: INFO os_vif [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:90:d6,bridge_name='br-int',has_traffic_filtering=True,id=09043b02-fceb-424b-9f68-a526293780c2,network=Network(648a2400-b581-4a51-a2f6-df676910ceee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09043b02-fc')
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] No BDM found with device name hda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] No VIF found with MAC fa:16:3e:45:27:91, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:08:42 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] No VIF found with MAC fa:16:3e:c2:fb:c4, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:08:42 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Using config drive
Nov 30 07:08:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:43 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Creating config drive at /opt/stack/data/nova/instances/cc583d29-3df4-4406-b5a5-f4b3d300fabb/disk.config
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cc583d29-3df4-4406-b5a5-f4b3d300fabb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuxm384j2 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cc583d29-3df4-4406-b5a5-f4b3d300fabb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuxm384j2" returned: 0 in 0.126s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-e8aa8c23-b7b1-4fed-80e2-ab511875b253 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-e8aa8c23-b7b1-4fed-80e2-ab511875b253 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:43 user nova-compute[75293]: WARNING nova.compute.manager [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-e8aa8c23-b7b1-4fed-80e2-ab511875b253 for instance with vm_state building and task_state spawning.
Nov 30 07:08:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-3d552b1b-e03f-49a7-9f26-50748172b6d0 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-3d552b1b-e03f-49a7-9f26-50748172b6d0 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:43 user nova-compute[75293]: WARNING nova.compute.manager [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-3d552b1b-e03f-49a7-9f26-50748172b6d0 for instance with vm_state building and task_state spawning.
Nov 30 07:08:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-3d552b1b-e03f-49a7-9f26-50748172b6d0 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-3d552b1b-e03f-49a7-9f26-50748172b6d0 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:43 user nova-compute[75293]: WARNING nova.compute.manager [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-3d552b1b-e03f-49a7-9f26-50748172b6d0 for instance with vm_state building and task_state spawning.
Nov 30 07:08:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-a746d18c-574c-4c72-b3af-c5d7d6387f9c {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-a746d18c-574c-4c72-b3af-c5d7d6387f9c {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:43 user nova-compute[75293]: WARNING nova.compute.manager [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-a746d18c-574c-4c72-b3af-c5d7d6387f9c for instance with vm_state building and task_state spawning.
Nov 30 07:08:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-a746d18c-574c-4c72-b3af-c5d7d6387f9c {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-a746d18c-574c-4c72-b3af-c5d7d6387f9c {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:43 user nova-compute[75293]: WARNING nova.compute.manager [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-a746d18c-574c-4c72-b3af-c5d7d6387f9c for instance with vm_state building and task_state spawning.
Nov 30 07:08:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-177273b3-02d1-4f5c-ae31-70103280dd88 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-177273b3-02d1-4f5c-ae31-70103280dd88 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:43 user nova-compute[75293]: WARNING nova.compute.manager [req-846b0a74-b2f2-48f3-a88f-3d77da71ee3e req-fc629190-335e-4447-a26d-5084297db117 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-177273b3-02d1-4f5c-ae31-70103280dd88 for instance with vm_state building and task_state spawning.
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:08:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG nova.compute.manager [req-0cc72942-794e-49d4-a7c1-b32071a53d17 req-5087e4f6-9aba-4d82-a869-d56ff3f54123 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-b9ac9e07-c027-4b26-ab1f-fe548b6a74a9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0cc72942-794e-49d4-a7c1-b32071a53d17 req-5087e4f6-9aba-4d82-a869-d56ff3f54123 service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0cc72942-794e-49d4-a7c1-b32071a53d17 req-5087e4f6-9aba-4d82-a869-d56ff3f54123 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0cc72942-794e-49d4-a7c1-b32071a53d17 req-5087e4f6-9aba-4d82-a869-d56ff3f54123 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG nova.compute.manager [req-0cc72942-794e-49d4-a7c1-b32071a53d17 req-5087e4f6-9aba-4d82-a869-d56ff3f54123 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-b9ac9e07-c027-4b26-ab1f-fe548b6a74a9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:44 user nova-compute[75293]: WARNING nova.compute.manager [req-0cc72942-794e-49d4-a7c1-b32071a53d17 req-5087e4f6-9aba-4d82-a869-d56ff3f54123 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-b9ac9e07-c027-4b26-ab1f-fe548b6a74a9 for instance with vm_state building and task_state spawning.
Nov 30 07:08:44 user nova-compute[75293]: DEBUG nova.compute.manager [req-0cc72942-794e-49d4-a7c1-b32071a53d17 req-5087e4f6-9aba-4d82-a869-d56ff3f54123 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-ab42e005-7e8c-4b45-a30b-c4f1c743b3a4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0cc72942-794e-49d4-a7c1-b32071a53d17 req-5087e4f6-9aba-4d82-a869-d56ff3f54123 service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0cc72942-794e-49d4-a7c1-b32071a53d17 req-5087e4f6-9aba-4d82-a869-d56ff3f54123 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0cc72942-794e-49d4-a7c1-b32071a53d17 req-5087e4f6-9aba-4d82-a869-d56ff3f54123 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG nova.compute.manager [req-0cc72942-794e-49d4-a7c1-b32071a53d17 req-5087e4f6-9aba-4d82-a869-d56ff3f54123 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-ab42e005-7e8c-4b45-a30b-c4f1c743b3a4 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:44 user nova-compute[75293]: WARNING nova.compute.manager [req-0cc72942-794e-49d4-a7c1-b32071a53d17 req-5087e4f6-9aba-4d82-a869-d56ff3f54123 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-ab42e005-7e8c-4b45-a30b-c4f1c743b3a4 for instance with vm_state building and task_state spawning.
Nov 30 07:08:44 user nova-compute[75293]: DEBUG nova.compute.manager [req-0cc72942-794e-49d4-a7c1-b32071a53d17 req-5087e4f6-9aba-4d82-a869-d56ff3f54123 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-ab42e005-7e8c-4b45-a30b-c4f1c743b3a4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0cc72942-794e-49d4-a7c1-b32071a53d17 req-5087e4f6-9aba-4d82-a869-d56ff3f54123 service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0cc72942-794e-49d4-a7c1-b32071a53d17 req-5087e4f6-9aba-4d82-a869-d56ff3f54123 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0cc72942-794e-49d4-a7c1-b32071a53d17 req-5087e4f6-9aba-4d82-a869-d56ff3f54123 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG nova.compute.manager [req-0cc72942-794e-49d4-a7c1-b32071a53d17 req-5087e4f6-9aba-4d82-a869-d56ff3f54123 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-ab42e005-7e8c-4b45-a30b-c4f1c743b3a4 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:44 user nova-compute[75293]: WARNING nova.compute.manager [req-0cc72942-794e-49d4-a7c1-b32071a53d17 req-5087e4f6-9aba-4d82-a869-d56ff3f54123 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-ab42e005-7e8c-4b45-a30b-c4f1c743b3a4 for instance with vm_state building and task_state spawning.
Nov 30 07:08:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG nova.compute.manager [req-83ab9341-dd6a-4c8b-9a87-40997936e470 req-48029951-3185-417d-9b36-6fbc18a6b653 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-83ab9341-dd6a-4c8b-9a87-40997936e470 req-48029951-3185-417d-9b36-6fbc18a6b653 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-83ab9341-dd6a-4c8b-9a87-40997936e470 req-48029951-3185-417d-9b36-6fbc18a6b653 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-83ab9341-dd6a-4c8b-9a87-40997936e470 req-48029951-3185-417d-9b36-6fbc18a6b653 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG nova.compute.manager [req-83ab9341-dd6a-4c8b-9a87-40997936e470 req-48029951-3185-417d-9b36-6fbc18a6b653 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:45 user nova-compute[75293]: WARNING nova.compute.manager [req-83ab9341-dd6a-4c8b-9a87-40997936e470 req-48029951-3185-417d-9b36-6fbc18a6b653 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6 for instance with vm_state building and task_state spawning.
Nov 30 07:08:45 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:08:45 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Instance spawned successfully.
Nov 30 07:08:45 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:45 user nova-compute[75293]: INFO nova.compute.manager [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Took 13.20 seconds to spawn the instance on the hypervisor.
Nov 30 07:08:45 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:08:45 user nova-compute[75293]: INFO nova.compute.manager [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Took 42.56 seconds to build instance.
Nov 30 07:08:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b950c47d-76fe-4ec9-83b8-33b1feeb7ae1 tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.683s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG nova.compute.manager [req-48f4299a-0745-415e-9663-97c0b1e1230b req-50449a99-4ca3-4cbd-ac6e-c054eb4d5637 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-177273b3-02d1-4f5c-ae31-70103280dd88 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-48f4299a-0745-415e-9663-97c0b1e1230b req-50449a99-4ca3-4cbd-ac6e-c054eb4d5637 service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-48f4299a-0745-415e-9663-97c0b1e1230b req-50449a99-4ca3-4cbd-ac6e-c054eb4d5637 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-48f4299a-0745-415e-9663-97c0b1e1230b req-50449a99-4ca3-4cbd-ac6e-c054eb4d5637 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG nova.compute.manager [req-48f4299a-0745-415e-9663-97c0b1e1230b req-50449a99-4ca3-4cbd-ac6e-c054eb4d5637 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-177273b3-02d1-4f5c-ae31-70103280dd88 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:45 user nova-compute[75293]: WARNING nova.compute.manager [req-48f4299a-0745-415e-9663-97c0b1e1230b req-50449a99-4ca3-4cbd-ac6e-c054eb4d5637 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-177273b3-02d1-4f5c-ae31-70103280dd88 for instance with vm_state active and task_state None.
Nov 30 07:08:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG nova.compute.manager [req-5cb1f4a0-6576-4ca4-8472-0770240504da req-2b6590ae-420a-46bb-ab89-91d4712ac66c service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-666a23fb-99db-4762-9181-18e0fbbbfdf2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5cb1f4a0-6576-4ca4-8472-0770240504da req-2b6590ae-420a-46bb-ab89-91d4712ac66c service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5cb1f4a0-6576-4ca4-8472-0770240504da req-2b6590ae-420a-46bb-ab89-91d4712ac66c service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5cb1f4a0-6576-4ca4-8472-0770240504da req-2b6590ae-420a-46bb-ab89-91d4712ac66c service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG nova.compute.manager [req-5cb1f4a0-6576-4ca4-8472-0770240504da req-2b6590ae-420a-46bb-ab89-91d4712ac66c service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-666a23fb-99db-4762-9181-18e0fbbbfdf2 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:46 user nova-compute[75293]: WARNING nova.compute.manager [req-5cb1f4a0-6576-4ca4-8472-0770240504da req-2b6590ae-420a-46bb-ab89-91d4712ac66c service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-666a23fb-99db-4762-9181-18e0fbbbfdf2 for instance with vm_state building and task_state spawning.
Nov 30 07:08:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:47 user nova-compute[75293]: WARNING nova.compute.manager [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6 for instance with vm_state building and task_state spawning.
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-60e4fab9-df41-42dd-be40-1300f77a7d89 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-60e4fab9-df41-42dd-be40-1300f77a7d89 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:47 user nova-compute[75293]: WARNING nova.compute.manager [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-60e4fab9-df41-42dd-be40-1300f77a7d89 for instance with vm_state building and task_state spawning.
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-60e4fab9-df41-42dd-be40-1300f77a7d89 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-60e4fab9-df41-42dd-be40-1300f77a7d89 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:47 user nova-compute[75293]: WARNING nova.compute.manager [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-60e4fab9-df41-42dd-be40-1300f77a7d89 for instance with vm_state building and task_state spawning.
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-b998882b-1d11-404b-930e-91b355ded504 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-b998882b-1d11-404b-930e-91b355ded504 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:47 user nova-compute[75293]: WARNING nova.compute.manager [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-b998882b-1d11-404b-930e-91b355ded504 for instance with vm_state building and task_state spawning.
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-b998882b-1d11-404b-930e-91b355ded504 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-b998882b-1d11-404b-930e-91b355ded504 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:47 user nova-compute[75293]: WARNING nova.compute.manager [req-1a029a4d-a10a-40cf-a408-8c4fe64ec5bd req-b86cf40e-57b9-402e-a90b-b335f7259b02 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-b998882b-1d11-404b-930e-91b355ded504 for instance with vm_state building and task_state spawning.
Nov 30 07:08:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-b73c69b2-9f21-4615-80a4-7676df8071bd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-b73c69b2-9f21-4615-80a4-7676df8071bd {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:47 user nova-compute[75293]: WARNING nova.compute.manager [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-b73c69b2-9f21-4615-80a4-7676df8071bd for instance with vm_state building and task_state spawning.
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-b73c69b2-9f21-4615-80a4-7676df8071bd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-b73c69b2-9f21-4615-80a4-7676df8071bd {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:47 user nova-compute[75293]: WARNING nova.compute.manager [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-b73c69b2-9f21-4615-80a4-7676df8071bd for instance with vm_state building and task_state spawning.
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-dbb92875-8448-4085-8275-c9cb21d80edf {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-dbb92875-8448-4085-8275-c9cb21d80edf {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:47 user nova-compute[75293]: WARNING nova.compute.manager [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-dbb92875-8448-4085-8275-c9cb21d80edf for instance with vm_state building and task_state spawning.
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-dbb92875-8448-4085-8275-c9cb21d80edf {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-dbb92875-8448-4085-8275-c9cb21d80edf {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:47 user nova-compute[75293]: WARNING nova.compute.manager [req-546f5064-6008-4384-a2a9-439f454d09e7 req-2252999a-e139-4241-bd11-f0ed2f987ad9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-dbb92875-8448-4085-8275-c9cb21d80edf for instance with vm_state building and task_state spawning.
Nov 30 07:08:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-1b7deb0a-39af-4d93-b93d-5765a731f702" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-1b7deb0a-39af-4d93-b93d-5765a731f702" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Updating instance_info_cache with network_info: [{"id": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "address": "fa:16:3e:bb:63:ac", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f5514b-92", "ovs_interfaceid": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-1b7deb0a-39af-4d93-b93d-5765a731f702" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG nova.compute.manager [req-30171bd2-0eb4-4c72-a2aa-0fa41f97a441 req-62d54595-daf2-45fc-b4bf-31ce25a116a9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-666a23fb-99db-4762-9181-18e0fbbbfdf2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-30171bd2-0eb4-4c72-a2aa-0fa41f97a441 req-62d54595-daf2-45fc-b4bf-31ce25a116a9 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-30171bd2-0eb4-4c72-a2aa-0fa41f97a441 req-62d54595-daf2-45fc-b4bf-31ce25a116a9 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-30171bd2-0eb4-4c72-a2aa-0fa41f97a441 req-62d54595-daf2-45fc-b4bf-31ce25a116a9 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG nova.compute.manager [req-30171bd2-0eb4-4c72-a2aa-0fa41f97a441 req-62d54595-daf2-45fc-b4bf-31ce25a116a9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-666a23fb-99db-4762-9181-18e0fbbbfdf2 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:48 user nova-compute[75293]: WARNING nova.compute.manager [req-30171bd2-0eb4-4c72-a2aa-0fa41f97a441 req-62d54595-daf2-45fc-b4bf-31ce25a116a9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-666a23fb-99db-4762-9181-18e0fbbbfdf2 for instance with vm_state building and task_state spawning.
Nov 30 07:08:48 user nova-compute[75293]: DEBUG nova.compute.manager [req-30171bd2-0eb4-4c72-a2aa-0fa41f97a441 req-62d54595-daf2-45fc-b4bf-31ce25a116a9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-09043b02-fceb-424b-9f68-a526293780c2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-30171bd2-0eb4-4c72-a2aa-0fa41f97a441 req-62d54595-daf2-45fc-b4bf-31ce25a116a9 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-30171bd2-0eb4-4c72-a2aa-0fa41f97a441 req-62d54595-daf2-45fc-b4bf-31ce25a116a9 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-30171bd2-0eb4-4c72-a2aa-0fa41f97a441 req-62d54595-daf2-45fc-b4bf-31ce25a116a9 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG nova.compute.manager [req-30171bd2-0eb4-4c72-a2aa-0fa41f97a441 req-62d54595-daf2-45fc-b4bf-31ce25a116a9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-09043b02-fceb-424b-9f68-a526293780c2 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:48 user nova-compute[75293]: WARNING nova.compute.manager [req-30171bd2-0eb4-4c72-a2aa-0fa41f97a441 req-62d54595-daf2-45fc-b4bf-31ce25a116a9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-09043b02-fceb-424b-9f68-a526293780c2 for instance with vm_state building and task_state spawning.
Nov 30 07:08:48 user nova-compute[75293]: DEBUG nova.compute.manager [req-30171bd2-0eb4-4c72-a2aa-0fa41f97a441 req-62d54595-daf2-45fc-b4bf-31ce25a116a9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-09043b02-fceb-424b-9f68-a526293780c2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-30171bd2-0eb4-4c72-a2aa-0fa41f97a441 req-62d54595-daf2-45fc-b4bf-31ce25a116a9 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-30171bd2-0eb4-4c72-a2aa-0fa41f97a441 req-62d54595-daf2-45fc-b4bf-31ce25a116a9 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-30171bd2-0eb4-4c72-a2aa-0fa41f97a441 req-62d54595-daf2-45fc-b4bf-31ce25a116a9 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG nova.compute.manager [req-30171bd2-0eb4-4c72-a2aa-0fa41f97a441 req-62d54595-daf2-45fc-b4bf-31ce25a116a9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-09043b02-fceb-424b-9f68-a526293780c2 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:48 user nova-compute[75293]: WARNING nova.compute.manager [req-30171bd2-0eb4-4c72-a2aa-0fa41f97a441 req-62d54595-daf2-45fc-b4bf-31ce25a116a9 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-09043b02-fceb-424b-9f68-a526293780c2 for instance with vm_state building and task_state spawning.
Nov 30 07:08:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:49 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:08:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:08:49 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Instance spawned successfully.
Nov 30 07:08:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:08:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:08:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:08:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:08:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:08:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:08:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:08:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:49 user nova-compute[75293]: INFO nova.compute.manager [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Took 15.53 seconds to spawn the instance on the hypervisor.
Nov 30 07:08:49 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:08:49 user nova-compute[75293]: INFO nova.compute.manager [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Took 42.77 seconds to build instance.
Nov 30 07:08:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b778d2a2-8337-42a4-975b-fef4e15328b1 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.940s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG nova.compute.manager [req-77ad1c48-ef3e-44ed-a7b4-86ba69c976fd req-1e48a17f-1e89-4cc7-9c73-2f24f8462720 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received event network-changed-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG nova.compute.manager [req-77ad1c48-ef3e-44ed-a7b4-86ba69c976fd req-1e48a17f-1e89-4cc7-9c73-2f24f8462720 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Refreshing instance network info cache due to event network-changed-7cf6968f-9b43-4e24-9ade-d296716616fe. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-77ad1c48-ef3e-44ed-a7b4-86ba69c976fd req-1e48a17f-1e89-4cc7-9c73-2f24f8462720 service nova] Acquiring lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-77ad1c48-ef3e-44ed-a7b4-86ba69c976fd req-1e48a17f-1e89-4cc7-9c73-2f24f8462720 service nova] Acquired lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG nova.network.neutron [req-77ad1c48-ef3e-44ed-a7b4-86ba69c976fd req-1e48a17f-1e89-4cc7-9c73-2f24f8462720 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Refreshing network info cache for port 7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG nova.compute.manager [req-812acdd3-bf30-4c20-a1ba-99b3db5eb36d req-5022dad5-7d22-4e59-a085-42298248a133 service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Received event network-changed-26f5514b-9205-4e17-9d2b-2196aaa085d2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG nova.compute.manager [req-812acdd3-bf30-4c20-a1ba-99b3db5eb36d req-5022dad5-7d22-4e59-a085-42298248a133 service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Refreshing instance network info cache due to event network-changed-26f5514b-9205-4e17-9d2b-2196aaa085d2. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-812acdd3-bf30-4c20-a1ba-99b3db5eb36d req-5022dad5-7d22-4e59-a085-42298248a133 service nova] Acquiring lock "refresh_cache-1b7deb0a-39af-4d93-b93d-5765a731f702" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-812acdd3-bf30-4c20-a1ba-99b3db5eb36d req-5022dad5-7d22-4e59-a085-42298248a133 service nova] Acquired lock "refresh_cache-1b7deb0a-39af-4d93-b93d-5765a731f702" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG nova.network.neutron [req-812acdd3-bf30-4c20-a1ba-99b3db5eb36d req-5022dad5-7d22-4e59-a085-42298248a133 service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Refreshing network info cache for port 26f5514b-9205-4e17-9d2b-2196aaa085d2 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG nova.compute.manager [req-5430adbd-0c88-44bc-a871-18694f50b476 req-12cb5b25-d9fc-41a8-a6d3-38223825defe service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-changed-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG nova.compute.manager [req-5430adbd-0c88-44bc-a871-18694f50b476 req-12cb5b25-d9fc-41a8-a6d3-38223825defe service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Refreshing instance network info cache due to event network-changed-59532faa-7c54-4c8f-ac5f-bea10353a48d. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5430adbd-0c88-44bc-a871-18694f50b476 req-12cb5b25-d9fc-41a8-a6d3-38223825defe service nova] Acquiring lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5430adbd-0c88-44bc-a871-18694f50b476 req-12cb5b25-d9fc-41a8-a6d3-38223825defe service nova] Acquired lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG nova.network.neutron [req-5430adbd-0c88-44bc-a871-18694f50b476 req-12cb5b25-d9fc-41a8-a6d3-38223825defe service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Refreshing network info cache for port 59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:51 user nova-compute[75293]: DEBUG nova.network.neutron [req-812acdd3-bf30-4c20-a1ba-99b3db5eb36d req-5022dad5-7d22-4e59-a085-42298248a133 service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Updated VIF entry in instance network info cache for port 26f5514b-9205-4e17-9d2b-2196aaa085d2. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:08:51 user nova-compute[75293]: DEBUG nova.network.neutron [req-812acdd3-bf30-4c20-a1ba-99b3db5eb36d req-5022dad5-7d22-4e59-a085-42298248a133 service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Updating instance_info_cache with network_info: [{"id": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "address": "fa:16:3e:bb:63:ac", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f5514b-92", "ovs_interfaceid": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:51 user nova-compute[75293]: DEBUG nova.network.neutron [req-77ad1c48-ef3e-44ed-a7b4-86ba69c976fd req-1e48a17f-1e89-4cc7-9c73-2f24f8462720 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Updated VIF entry in instance network info cache for port 7cf6968f-9b43-4e24-9ade-d296716616fe. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:08:51 user nova-compute[75293]: DEBUG nova.network.neutron [req-77ad1c48-ef3e-44ed-a7b4-86ba69c976fd req-1e48a17f-1e89-4cc7-9c73-2f24f8462720 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Updating instance_info_cache with network_info: [{"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-812acdd3-bf30-4c20-a1ba-99b3db5eb36d req-5022dad5-7d22-4e59-a085-42298248a133 service nova] Releasing lock "refresh_cache-1b7deb0a-39af-4d93-b93d-5765a731f702" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-77ad1c48-ef3e-44ed-a7b4-86ba69c976fd req-1e48a17f-1e89-4cc7-9c73-2f24f8462720 service nova] Releasing lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:51 user nova-compute[75293]: DEBUG nova.network.neutron [req-5430adbd-0c88-44bc-a871-18694f50b476 req-12cb5b25-d9fc-41a8-a6d3-38223825defe service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Updated VIF entry in instance network info cache for port 59532faa-7c54-4c8f-ac5f-bea10353a48d. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:08:51 user nova-compute[75293]: DEBUG nova.network.neutron [req-5430adbd-0c88-44bc-a871-18694f50b476 req-12cb5b25-d9fc-41a8-a6d3-38223825defe service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Updating instance_info_cache with network_info: [{"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:08:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5430adbd-0c88-44bc-a871-18694f50b476 req-12cb5b25-d9fc-41a8-a6d3-38223825defe service nova] Releasing lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:08:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:52 user nova-compute[75293]: DEBUG nova.compute.manager [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:08:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:52 user nova-compute[75293]: INFO nova.compute.manager [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] instance snapshotting
Nov 30 07:08:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:52 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Beginning live snapshot process
Nov 30 07:08:52 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json -f qcow2 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:52 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:08:52 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:08:52 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:08:52 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:08:52 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:08:52 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json -f qcow2" returned: 0 in 0.595s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json -f qcow2 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:53 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:08:53 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:08:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=6847MB free_disk=25.429576873779297GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json -f qcow2" returned: 0 in 0.215s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b6dee8d-d419-47a3-b2be-4d15e17d6061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b7deb0a-39af-4d93-b93d-5765a731f702 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 251604ac-b300-49ae-ae1a-4543665fead6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance bb71c604-7f7e-4b71-8fa3-56bd77b649c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance dcd1ca28-3784-45b3-a3d3-e3231d8e82bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 061832ab-930a-470b-8b4f-dfc8f19fea6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 67b8a66b-e7f8-41a1-8f5c-b29851ec608d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 4ca1e46c-e83f-4476-a225-79e83151e222 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance ca1e65f3-8696-4c9a-b4df-ce5923e1de31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 09b63cd9-2f63-411d-886d-3ff237d145d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance cc583d29-3df4-4406-b5a5-f4b3d300fabb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.202s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4efgynh4/b0be077048ec4631bf0b1efc44745a7d.delta 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4efgynh4/b0be077048ec4631bf0b1efc44745a7d.delta 1073741824" returned: 0 in 0.055s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:53 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 07:08:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75293) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 30 07:08:54 user nova-compute[75293]: INFO nova.virt.libvirt.host [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] UEFI support detected
Nov 30 07:08:54 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:08:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "251604ac-b300-49ae-ae1a-4543665fead6" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "251604ac-b300-49ae-ae1a-4543665fead6" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:54 user nova-compute[75293]: INFO nova.compute.manager [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Shelving
Nov 30 07:08:54 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:08:54 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:08:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.690s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:54 user nova-compute[75293]: DEBUG nova.compute.manager [req-b4673bab-2e51-4041-b58e-7598c09e9b19 req-ad250916-2f7d-4b7e-8479-23ed69c867f7 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received event network-vif-unplugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b4673bab-2e51-4041-b58e-7598c09e9b19 req-ad250916-2f7d-4b7e-8479-23ed69c867f7 service nova] Acquiring lock "251604ac-b300-49ae-ae1a-4543665fead6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b4673bab-2e51-4041-b58e-7598c09e9b19 req-ad250916-2f7d-4b7e-8479-23ed69c867f7 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b4673bab-2e51-4041-b58e-7598c09e9b19 req-ad250916-2f7d-4b7e-8479-23ed69c867f7 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:54 user nova-compute[75293]: DEBUG nova.compute.manager [req-b4673bab-2e51-4041-b58e-7598c09e9b19 req-ad250916-2f7d-4b7e-8479-23ed69c867f7 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] No waiting events found dispatching network-vif-unplugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:54 user nova-compute[75293]: WARNING nova.compute.manager [req-b4673bab-2e51-4041-b58e-7598c09e9b19 req-ad250916-2f7d-4b7e-8479-23ed69c867f7 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received unexpected event network-vif-unplugged-7cf6968f-9b43-4e24-9ade-d296716616fe for instance with vm_state active and task_state shelving.
Nov 30 07:08:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:08:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:55 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Instance destroyed successfully.
Nov 30 07:08:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] COPY block job progress, current cursor: 27918336 final cursor: 75497472 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:08:55 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Beginning cold snapshot process
Nov 30 07:08:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:55 user nova-compute[75293]: DEBUG nova.privsep.utils [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75293) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 07:08:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk /opt/stack/data/nova/instances/snapshots/tmpbbrr053n/84725a4c771e4a27ba3f786ddc0be11b {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:08:56 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 07:08:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG nova.privsep.utils [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75293) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4efgynh4/b0be077048ec4631bf0b1efc44745a7d.delta /opt/stack/data/nova/instances/snapshots/tmp4efgynh4/b0be077048ec4631bf0b1efc44745a7d {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG nova.compute.manager [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received event network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] Acquiring lock "251604ac-b300-49ae-ae1a-4543665fead6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG nova.compute.manager [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] No waiting events found dispatching network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:56 user nova-compute[75293]: WARNING nova.compute.manager [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received unexpected event network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 30 07:08:56 user nova-compute[75293]: DEBUG nova.compute.manager [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received event network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] Acquiring lock "251604ac-b300-49ae-ae1a-4543665fead6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG nova.compute.manager [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] No waiting events found dispatching network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:56 user nova-compute[75293]: WARNING nova.compute.manager [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received unexpected event network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 30 07:08:56 user nova-compute[75293]: DEBUG nova.compute.manager [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received event network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] Acquiring lock "251604ac-b300-49ae-ae1a-4543665fead6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG nova.compute.manager [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] No waiting events found dispatching network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:56 user nova-compute[75293]: WARNING nova.compute.manager [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received unexpected event network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 30 07:08:56 user nova-compute[75293]: DEBUG nova.compute.manager [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received event network-vif-unplugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] Acquiring lock "251604ac-b300-49ae-ae1a-4543665fead6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG nova.compute.manager [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] No waiting events found dispatching network-vif-unplugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:56 user nova-compute[75293]: WARNING nova.compute.manager [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received unexpected event network-vif-unplugged-7cf6968f-9b43-4e24-9ade-d296716616fe for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 30 07:08:56 user nova-compute[75293]: DEBUG nova.compute.manager [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received event network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] Acquiring lock "251604ac-b300-49ae-ae1a-4543665fead6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:08:56 user nova-compute[75293]: DEBUG nova.compute.manager [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] No waiting events found dispatching network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:08:56 user nova-compute[75293]: WARNING nova.compute.manager [req-40a7b444-3e2d-4376-9cc3-3f14449443c0 req-ee5aacf9-db02-4f44-80f3-f337b4483623 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received unexpected event network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 30 07:08:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk /opt/stack/data/nova/instances/snapshots/tmpbbrr053n/84725a4c771e4a27ba3f786ddc0be11b" returned: 0 in 1.025s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:56 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Snapshot extracted, beginning image upload
Nov 30 07:08:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4efgynh4/b0be077048ec4631bf0b1efc44745a7d.delta /opt/stack/data/nova/instances/snapshots/tmp4efgynh4/b0be077048ec4631bf0b1efc44745a7d" returned: 0 in 0.691s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:08:56 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Snapshot extracted, beginning image upload
Nov 30 07:08:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:08:59 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Snapshot image upload complete
Nov 30 07:08:59 user nova-compute[75293]: INFO nova.compute.manager [None req-bc54ebe1-540d-4946-95a9-d6b59e434a5b tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Took 6.99 seconds to snapshot the instance on the hypervisor.
Nov 30 07:08:59 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Snapshot image upload complete
Nov 30 07:08:59 user nova-compute[75293]: DEBUG nova.compute.manager [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:08:59 user nova-compute[75293]: INFO nova.compute.manager [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Shelve offloading
Nov 30 07:08:59 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Instance destroyed successfully.
Nov 30 07:08:59 user nova-compute[75293]: DEBUG nova.compute.manager [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:08:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:08:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquired lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:08:59 user nova-compute[75293]: DEBUG nova.network.neutron [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG nova.network.neutron [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Updating instance_info_cache with network_info: [{"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Releasing lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:00 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Instance destroyed successfully.
Nov 30 07:09:00 user nova-compute[75293]: DEBUG nova.objects.instance [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'resources' on Instance uuid 251604ac-b300-49ae-ae1a-4543665fead6 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1720061760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1720061760',id=3,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmznsMjyME+bFayB3TzkgHrsSuO5TgKvjxqc/rUuOyL/QpV4coa/hjsQhBDMiu/ZZazrEo74EbBS+0CeSXDTbH3pDd0GHSp57yUHop6vH4ahe2AH3WPMcQ4QoMkQZr2Cw==',key_name='tempest-keypair-466117858',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:07:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='18aa2f5bea3d44ecb10ff083d6f76038',ramdisk_id='',reservation_id='r-8g0ngsgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-763079906',owner_user_name='tempest-AttachVolumeShelveTestJSON-763079906-project-member',shelved_at='2023-11-30T07:08:59.568664',shelved_host='user',shelved_image_id='57176440-5d28-49e2-80f6-f0422797ab9a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:08:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e385a89f913645dd9fd2770e6e7445da',uuid=251604ac-b300-49ae-ae1a-4543665fead6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converting VIF {"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=7cf6968f-9b43-4e24-9ade-d296716616fe,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf6968f-9b') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG os_vif [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=7cf6968f-9b43-4e24-9ade-d296716616fe,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf6968f-9b') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-3a77f2a6-8b4c-4e3c-bca2-2a7300a89bb8 req-8087864d-650c-458c-a11c-ecd5c59595e2 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received event network-changed-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-3a77f2a6-8b4c-4e3c-bca2-2a7300a89bb8 req-8087864d-650c-458c-a11c-ecd5c59595e2 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Refreshing instance network info cache due to event network-changed-7cf6968f-9b43-4e24-9ade-d296716616fe. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3a77f2a6-8b4c-4e3c-bca2-2a7300a89bb8 req-8087864d-650c-458c-a11c-ecd5c59595e2 service nova] Acquiring lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3a77f2a6-8b4c-4e3c-bca2-2a7300a89bb8 req-8087864d-650c-458c-a11c-ecd5c59595e2 service nova] Acquired lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG nova.network.neutron [req-3a77f2a6-8b4c-4e3c-bca2-2a7300a89bb8 req-8087864d-650c-458c-a11c-ecd5c59595e2 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Refreshing network info cache for port 7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cf6968f-9b, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1246f9e6-4516-4606-bf3f-62e847f43ed0) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:00 user nova-compute[75293]: INFO os_vif [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=7cf6968f-9b43-4e24-9ade-d296716616fe,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf6968f-9b')
Nov 30 07:09:00 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Deleting instance files /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6_del
Nov 30 07:09:00 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Deletion of /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6_del complete
Nov 30 07:09:00 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Deleted allocations for instance 251604ac-b300-49ae-ae1a-4543665fead6
Nov 30 07:09:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:00 user nova-compute[75293]: DEBUG nova.objects.instance [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'numa_topology' on Instance uuid 251604ac-b300-49ae-ae1a-4543665fead6 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:01 user nova-compute[75293]: DEBUG nova.objects.base [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Object Instance<251604ac-b300-49ae-ae1a-4543665fead6> lazy-loaded attributes: resources,numa_topology {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:09:01 user nova-compute[75293]: DEBUG nova.network.neutron [req-3a77f2a6-8b4c-4e3c-bca2-2a7300a89bb8 req-8087864d-650c-458c-a11c-ecd5c59595e2 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Updated VIF entry in instance network info cache for port 7cf6968f-9b43-4e24-9ade-d296716616fe. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:09:01 user nova-compute[75293]: DEBUG nova.network.neutron [req-3a77f2a6-8b4c-4e3c-bca2-2a7300a89bb8 req-8087864d-650c-458c-a11c-ecd5c59595e2 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Updating instance_info_cache with network_info: [{"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:09:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3a77f2a6-8b4c-4e3c-bca2-2a7300a89bb8 req-8087864d-650c-458c-a11c-ecd5c59595e2 service nova] Releasing lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:09:01 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:09:01 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:09:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4849f128-2f0d-4c1b-ad13-95fd2ae23508 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "251604ac-b300-49ae-ae1a-4543665fead6" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.191s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-3f8b5587-fdcb-4f98-a5c0-705904f952e2 req-be27a912-dda4-4648-b25d-f36343fb5170 service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Received event network-changed-53964f53-7286-4710-bc56-709f3d460ba2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-3f8b5587-fdcb-4f98-a5c0-705904f952e2 req-be27a912-dda4-4648-b25d-f36343fb5170 service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Refreshing instance network info cache due to event network-changed-53964f53-7286-4710-bc56-709f3d460ba2. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:09:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3f8b5587-fdcb-4f98-a5c0-705904f952e2 req-be27a912-dda4-4648-b25d-f36343fb5170 service nova] Acquiring lock "refresh_cache-bb71c604-7f7e-4b71-8fa3-56bd77b649c3" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:09:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3f8b5587-fdcb-4f98-a5c0-705904f952e2 req-be27a912-dda4-4648-b25d-f36343fb5170 service nova] Acquired lock "refresh_cache-bb71c604-7f7e-4b71-8fa3-56bd77b649c3" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:09:03 user nova-compute[75293]: DEBUG nova.network.neutron [req-3f8b5587-fdcb-4f98-a5c0-705904f952e2 req-be27a912-dda4-4648-b25d-f36343fb5170 service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Refreshing network info cache for port 53964f53-7286-4710-bc56-709f3d460ba2 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:09:03 user nova-compute[75293]: DEBUG nova.network.neutron [req-3f8b5587-fdcb-4f98-a5c0-705904f952e2 req-be27a912-dda4-4648-b25d-f36343fb5170 service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Updated VIF entry in instance network info cache for port 53964f53-7286-4710-bc56-709f3d460ba2. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:09:03 user nova-compute[75293]: DEBUG nova.network.neutron [req-3f8b5587-fdcb-4f98-a5c0-705904f952e2 req-be27a912-dda4-4648-b25d-f36343fb5170 service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Updating instance_info_cache with network_info: [{"id": "53964f53-7286-4710-bc56-709f3d460ba2", "address": "fa:16:3e:f7:a6:d9", "network": {"id": "3a2529a8-0610-4c6a-8844-84b457a6e027", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1879734062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2dd909b1384539ac2fa74ece5501f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53964f53-72", "ovs_interfaceid": "53964f53-7286-4710-bc56-709f3d460ba2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:09:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3f8b5587-fdcb-4f98-a5c0-705904f952e2 req-be27a912-dda4-4648-b25d-f36343fb5170 service nova] Releasing lock "refresh_cache-bb71c604-7f7e-4b71-8fa3-56bd77b649c3" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG nova.compute.manager [req-f88b203e-1ba0-41ed-8194-465ef4bc0eaa req-7a7b11cd-1a2e-4b24-aea6-872d0ee34610 service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Received event network-changed-60fdc1a9-8616-40a3-9380-b675ff1b3239 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG nova.compute.manager [req-f88b203e-1ba0-41ed-8194-465ef4bc0eaa req-7a7b11cd-1a2e-4b24-aea6-872d0ee34610 service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Refreshing instance network info cache due to event network-changed-60fdc1a9-8616-40a3-9380-b675ff1b3239. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f88b203e-1ba0-41ed-8194-465ef4bc0eaa req-7a7b11cd-1a2e-4b24-aea6-872d0ee34610 service nova] Acquiring lock "refresh_cache-dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f88b203e-1ba0-41ed-8194-465ef4bc0eaa req-7a7b11cd-1a2e-4b24-aea6-872d0ee34610 service nova] Acquired lock "refresh_cache-dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG nova.network.neutron [req-f88b203e-1ba0-41ed-8194-465ef4bc0eaa req-7a7b11cd-1a2e-4b24-aea6-872d0ee34610 service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Refreshing network info cache for port 60fdc1a9-8616-40a3-9380-b675ff1b3239 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Acquiring lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lazy-loading 'flavor' on Instance uuid dcd1ca28-3784-45b3-a3d3-e3231d8e82bb {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG nova.network.neutron [req-f88b203e-1ba0-41ed-8194-465ef4bc0eaa req-7a7b11cd-1a2e-4b24-aea6-872d0ee34610 service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Updated VIF entry in instance network info cache for port 60fdc1a9-8616-40a3-9380-b675ff1b3239. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG nova.network.neutron [req-f88b203e-1ba0-41ed-8194-465ef4bc0eaa req-7a7b11cd-1a2e-4b24-aea6-872d0ee34610 service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Updating instance_info_cache with network_info: [{"id": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "address": "fa:16:3e:70:14:32", "network": {"id": "874f6f69-e233-46c8-b3a1-1e056bb291f2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1191377101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a232105c95a42669fd04b62416ded2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fdc1a9-86", "ovs_interfaceid": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f88b203e-1ba0-41ed-8194-465ef4bc0eaa req-7a7b11cd-1a2e-4b24-aea6-872d0ee34610 service nova] Releasing lock "refresh_cache-dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Acquiring lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:05 user nova-compute[75293]: INFO nova.compute.manager [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Attaching volume 3a07d874-8250-4118-823e-acc286caf324 to /dev/vdb
Nov 30 07:09:05 user nova-compute[75293]: DEBUG os_brick.utils [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d771c469-3932-42ec-aa93-cf94f53cda0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e55ca91-3d36-4e61-8bfe-21d389877f1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ed401d-5aef-4936-a1e5-b652334cdb66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa6ddee-9d85-4e1c-93b1-ceffb0fbf562]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:09:06 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[035d1fff-b903-4f7c-a997-69275fb49591]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG os_brick.utils [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Updating existing volume attachment record: f870fa79-27f8-4da1-9c84-15e9130cede5 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Acquiring lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lazy-loading 'flavor' on Instance uuid bb71c604-7f7e-4b71-8fa3-56bd77b649c3 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Acquiring lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:06 user nova-compute[75293]: INFO nova.compute.manager [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Attaching volume 2196509e-eb26-4f38-a1d1-f0a42ad93e7e to /dev/sdc
Nov 30 07:09:06 user nova-compute[75293]: DEBUG os_brick.utils [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[16564ef8-c7e1-4089-a8fd-829e9f48f731]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b645e0e2-d7ef-4829-8aca-a5d96251ea03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e74542-8ddd-4409-8b78-7954ca0b8975]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[15837b62-c3ed-4ae0-9adc-e3a95f32fb9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:09:06 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:09:06 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b73783-c6ac-4cf7-b2cf-0d42847f952c]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG os_brick.utils [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:06 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Updating existing volume attachment record: eaf72a52-9b46-4e39-b912-db0739a4b58f {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:09:07 user nova-compute[75293]: DEBUG nova.compute.manager [req-bf0e675a-1ebd-4c27-86ba-fade6d2a1f4e req-143e1a20-be0b-44f2-a58c-79ecccce2cff service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Received event network-changed-693d3de2-b91f-4efb-9e5e-2281d858ec0b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:07 user nova-compute[75293]: DEBUG nova.compute.manager [req-bf0e675a-1ebd-4c27-86ba-fade6d2a1f4e req-143e1a20-be0b-44f2-a58c-79ecccce2cff service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Refreshing instance network info cache due to event network-changed-693d3de2-b91f-4efb-9e5e-2281d858ec0b. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:09:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-bf0e675a-1ebd-4c27-86ba-fade6d2a1f4e req-143e1a20-be0b-44f2-a58c-79ecccce2cff service nova] Acquiring lock "refresh_cache-061832ab-930a-470b-8b4f-dfc8f19fea6b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:09:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-bf0e675a-1ebd-4c27-86ba-fade6d2a1f4e req-143e1a20-be0b-44f2-a58c-79ecccce2cff service nova] Acquired lock "refresh_cache-061832ab-930a-470b-8b4f-dfc8f19fea6b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:09:07 user nova-compute[75293]: DEBUG nova.network.neutron [req-bf0e675a-1ebd-4c27-86ba-fade6d2a1f4e req-143e1a20-be0b-44f2-a58c-79ecccce2cff service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Refreshing network info cache for port 693d3de2-b91f-4efb-9e5e-2281d858ec0b {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:09:07 user nova-compute[75293]: DEBUG nova.network.neutron [req-bf0e675a-1ebd-4c27-86ba-fade6d2a1f4e req-143e1a20-be0b-44f2-a58c-79ecccce2cff service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Updated VIF entry in instance network info cache for port 693d3de2-b91f-4efb-9e5e-2281d858ec0b. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:09:07 user nova-compute[75293]: DEBUG nova.network.neutron [req-bf0e675a-1ebd-4c27-86ba-fade6d2a1f4e req-143e1a20-be0b-44f2-a58c-79ecccce2cff service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Updating instance_info_cache with network_info: [{"id": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "address": "fa:16:3e:0a:7f:0a", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693d3de2-b9", "ovs_interfaceid": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:09:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-bf0e675a-1ebd-4c27-86ba-fade6d2a1f4e req-143e1a20-be0b-44f2-a58c-79ecccce2cff service nova] Releasing lock "refresh_cache-061832ab-930a-470b-8b4f-dfc8f19fea6b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:09:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "061832ab-930a-470b-8b4f-dfc8f19fea6b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG nova.objects.instance [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lazy-loading 'flavor' on Instance uuid 061832ab-930a-470b-8b4f-dfc8f19fea6b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "061832ab-930a-470b-8b4f-dfc8f19fea6b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:11 user nova-compute[75293]: INFO nova.compute.manager [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Attaching volume 80aa03ff-3ad8-434f-909e-580680bb32a6 to /dev/vdb
Nov 30 07:09:11 user nova-compute[75293]: DEBUG os_brick.utils [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac515a41-d1cd-41ca-9f12-5d330107ffe6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d927b8-8a30-4ac6-91a8-16fd4c3df97c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6bfd9a-7c83-4220-9c4e-8e2b8537ff22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[04007dfa-7dcd-46f0-9623-a86e14f20ee5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:09:11 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:09:11 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb9aa52-2af9-4fce-8965-9a6d4602bc8b]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG os_brick.utils [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:11 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Updating existing volume attachment record: e6c8eec0-2a99-414a-a6c8-a0d218277feb {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:09:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-d3dde6a6-30a5-462c-b452-bd28b743cd1f req-7029e86a-a8a9-40ca-9da3-695508aee2e1 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received event network-changed-4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-d3dde6a6-30a5-462c-b452-bd28b743cd1f req-7029e86a-a8a9-40ca-9da3-695508aee2e1 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Refreshing instance network info cache due to event network-changed-4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:09:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d3dde6a6-30a5-462c-b452-bd28b743cd1f req-7029e86a-a8a9-40ca-9da3-695508aee2e1 service nova] Acquiring lock "refresh_cache-67b8a66b-e7f8-41a1-8f5c-b29851ec608d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:09:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d3dde6a6-30a5-462c-b452-bd28b743cd1f req-7029e86a-a8a9-40ca-9da3-695508aee2e1 service nova] Acquired lock "refresh_cache-67b8a66b-e7f8-41a1-8f5c-b29851ec608d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:09:15 user nova-compute[75293]: DEBUG nova.network.neutron [req-d3dde6a6-30a5-462c-b452-bd28b743cd1f req-7029e86a-a8a9-40ca-9da3-695508aee2e1 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Refreshing network info cache for port 4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:09:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquiring lock "interface-67b8a66b-e7f8-41a1-8f5c-b29851ec608d-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "interface-67b8a66b-e7f8-41a1-8f5c-b29851ec608d-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:15 user nova-compute[75293]: DEBUG nova.objects.instance [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lazy-loading 'flavor' on Instance uuid 67b8a66b-e7f8-41a1-8f5c-b29851ec608d {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:15 user nova-compute[75293]: DEBUG nova.network.neutron [req-d3dde6a6-30a5-462c-b452-bd28b743cd1f req-7029e86a-a8a9-40ca-9da3-695508aee2e1 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Updated VIF entry in instance network info cache for port 4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:09:15 user nova-compute[75293]: DEBUG nova.network.neutron [req-d3dde6a6-30a5-462c-b452-bd28b743cd1f req-7029e86a-a8a9-40ca-9da3-695508aee2e1 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Updating instance_info_cache with network_info: [{"id": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "address": "fa:16:3e:2b:05:2c", "network": {"id": "ebc5494d-4e41-410c-a9ef-96a92a44d1d2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1004206243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4079c1bd-9b", "ovs_interfaceid": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:09:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d3dde6a6-30a5-462c-b452-bd28b743cd1f req-7029e86a-a8a9-40ca-9da3-695508aee2e1 service nova] Releasing lock "refresh_cache-67b8a66b-e7f8-41a1-8f5c-b29851ec608d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG nova.objects.instance [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lazy-loading 'pci_requests' on Instance uuid 67b8a66b-e7f8-41a1-8f5c-b29851ec608d {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG nova.objects.base [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Object Instance<67b8a66b-e7f8-41a1-8f5c-b29851ec608d> lazy-loaded attributes: flavor,pci_requests {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG nova.network.neutron [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG nova.policy [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3af22daef9746c99424bf6581cc7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67436111c10f475a9e2d249fe77f04c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZzqkOjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:16 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:16 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:16 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdb2346-c78b-46bb-93c7-33523da8f8a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:09:16 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aadc3b-d819-4113-a121-da0a4454acb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324] added
Nov 30 07:09:16 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.043s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8211ccca-1e65-4300-a85f-e12019477eb1]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d090528-1f91-4145-8047-16c06050c884]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZzqkOjK {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZzqkOjK" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4cfb4c-18e5-48bd-a4e1-6eee3621835f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dZzqkOjK'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8414dfa7-441b-48bd-97de-113deaf95b5d]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d87e961-bee2-4cd8-9b40-6869b686c35d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG nova.network.neutron [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Successfully created port: e9034327-6413-40df-842e-9ffbf58bb886 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f424f1f8-fa9e-4425-8b95-28080b98b26b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324, portal: 172.16.0.220,3260]
Nov 30 07:09:16 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324, portal: 172.16.0.220,3260] successful.
Nov 30 07:09:16 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tFZdEixO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:16 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2814eb6e-583c-4dbc-b20b-43f85665c688]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78de28d-e9b0-457b-b882-da5353d9b18c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:16 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[80621167-97e6-4dc5-829a-c591bcc5fcb1]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:09:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZzqkOjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG nova.network.neutron [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Successfully updated port: e9034327-6413-40df-842e-9ffbf58bb886 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquiring lock "refresh_cache-67b8a66b-e7f8-41a1-8f5c-b29851ec608d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquired lock "refresh_cache-67b8a66b-e7f8-41a1-8f5c-b29851ec608d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG nova.network.neutron [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-64a23a3d-ed06-4091-b3ee-136de1c3d567 req-cea2638b-af66-40ee-9c58-b1a5cb238ead service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received event network-changed-e9034327-6413-40df-842e-9ffbf58bb886 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-64a23a3d-ed06-4091-b3ee-136de1c3d567 req-cea2638b-af66-40ee-9c58-b1a5cb238ead service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Refreshing instance network info cache due to event network-changed-e9034327-6413-40df-842e-9ffbf58bb886. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-64a23a3d-ed06-4091-b3ee-136de1c3d567 req-cea2638b-af66-40ee-9c58-b1a5cb238ead service nova] Acquiring lock "refresh_cache-67b8a66b-e7f8-41a1-8f5c-b29851ec608d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '26233336133313363', 'path': '/dev/sdh'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233336133313363', 'path': '/dev/sdh'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.100s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:17 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:17 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:09:17 user nova-compute[75293]: DEBUG nova.network.neutron [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Updating instance_info_cache with network_info: [{"id": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "address": "fa:16:3e:2b:05:2c", "network": {"id": "ebc5494d-4e41-410c-a9ef-96a92a44d1d2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1004206243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4079c1bd-9b", "ovs_interfaceid": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9034327-6413-40df-842e-9ffbf58bb886", "address": "fa:16:3e:8c:13:37", "network": {"id": "b8c0f097-e9cb-4aa2-a925-da668439c435", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-656286509", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9034327-64", "ovs_interfaceid": "e9034327-6413-40df-842e-9ffbf58bb886", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lazy-loading 'flavor' on Instance uuid dcd1ca28-3784-45b3-a3d3-e3231d8e82bb {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe653c17-f4fa-4963-a66b-f7a085e9db76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:09:17 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Releasing lock "refresh_cache-67b8a66b-e7f8-41a1-8f5c-b29851ec608d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-64a23a3d-ed06-4091-b3ee-136de1c3d567 req-cea2638b-af66-40ee-9c58-b1a5cb238ead service nova] Acquired lock "refresh_cache-67b8a66b-e7f8-41a1-8f5c-b29851ec608d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG nova.network.neutron [req-64a23a3d-ed06-4091-b3ee-136de1c3d567 req-cea2638b-af66-40ee-9c58-b1a5cb238ead service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Refreshing network info cache for port e9034327-6413-40df-842e-9ffbf58bb886 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-448272992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-448272992',id=7,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjlAvbNSNxOu5edth1vYgsFbUXzkyrWPcRf1ffRD5CrTsh6WZzOo54MVbNVFLS5n8k7/BjeCIsOHkQu7rwF07QgVmeG30dScHl8rc2yZM/6i1oYAPea7ho5miPIPyzMag==',key_name='tempest-keypair-2066695250',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:07:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='67436111c10f475a9e2d249fe77f04c9',ramdisk_id='',reservation_id='r-p1eo2eq9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-825521733',owner_user_name='tempest-TaggedAttachmentsTest-825521733-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:07:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3af22daef9746c99424bf6581cc7608',uuid=67b8a66b-e7f8-41a1-8f5c-b29851ec608d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9034327-6413-40df-842e-9ffbf58bb886", "address": "fa:16:3e:8c:13:37", "network": {"id": "b8c0f097-e9cb-4aa2-a925-da668439c435", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-656286509", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9034327-64", "ovs_interfaceid": "e9034327-6413-40df-842e-9ffbf58bb886", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Converting VIF {"id": "e9034327-6413-40df-842e-9ffbf58bb886", "address": "fa:16:3e:8c:13:37", "network": {"id": "b8c0f097-e9cb-4aa2-a925-da668439c435", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-656286509", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9034327-64", "ovs_interfaceid": "e9034327-6413-40df-842e-9ffbf58bb886", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:13:37,bridge_name='br-int',has_traffic_filtering=True,id=e9034327-6413-40df-842e-9ffbf58bb886,network=Network(b8c0f097-e9cb-4aa2-a925-da668439c435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9034327-64') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG os_vif [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:13:37,bridge_name='br-int',has_traffic_filtering=True,id=e9034327-6413-40df-842e-9ffbf58bb886,network=Network(b8c0f097-e9cb-4aa2-a925-da668439c435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9034327-64') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0e579d-b6a5-44eb-ab95-ed67c7e8ee73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3eb6297-6206-561f-afb3-e6878176bfc7', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e] added
Nov 30 07:09:17 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:09:17 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:09:17 user nova-compute[75293]:   <source dev="/dev/sdh"/>
Nov 30 07:09:17 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:09:17 user nova-compute[75293]:   <serial>3a07d874-8250-4118-823e-acc286caf324</serial>
Nov 30 07:09:17 user nova-compute[75293]: </disk>
Nov 30 07:09:17 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9034327-64, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9034327-64, col_values=(('qos', UUID('143dffe4-7d89-4df4-837a-3110982055c8')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9034327-64, col_values=(('external_ids', {'iface-id': 'e9034327-6413-40df-842e-9ffbf58bb886', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:13:37', 'vm-uuid': '67b8a66b-e7f8-41a1-8f5c-b29851ec608d'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e832452d-1997-4400-b06f-b12886b378ee]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:17 user nova-compute[75293]: INFO os_vif [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:13:37,bridge_name='br-int',has_traffic_filtering=True,id=e9034327-6413-40df-842e-9ffbf58bb886,network=Network(b8c0f097-e9cb-4aa2-a925-da668439c435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9034327-64')
Nov 30 07:09:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-448272992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-448272992',id=7,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjlAvbNSNxOu5edth1vYgsFbUXzkyrWPcRf1ffRD5CrTsh6WZzOo54MVbNVFLS5n8k7/BjeCIsOHkQu7rwF07QgVmeG30dScHl8rc2yZM/6i1oYAPea7ho5miPIPyzMag==',key_name='tempest-keypair-2066695250',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:07:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='67436111c10f475a9e2d249fe77f04c9',ramdisk_id='',reservation_id='r-p1eo2eq9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-825521733',owner_user_name='tempest-TaggedAttachmentsTest-825521733-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:07:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3af22daef9746c99424bf6581cc7608',uuid=67b8a66b-e7f8-41a1-8f5c-b29851ec608d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9034327-6413-40df-842e-9ffbf58bb886", "address": "fa:16:3e:8c:13:37", "network": {"id": "b8c0f097-e9cb-4aa2-a925-da668439c435", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-656286509", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9034327-64", "ovs_interfaceid": "e9034327-6413-40df-842e-9ffbf58bb886", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Converting VIF {"id": "e9034327-6413-40df-842e-9ffbf58bb886", "address": "fa:16:3e:8c:13:37", "network": {"id": "b8c0f097-e9cb-4aa2-a925-da668439c435", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-656286509", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9034327-64", "ovs_interfaceid": "e9034327-6413-40df-842e-9ffbf58bb886", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:13:37,bridge_name='br-int',has_traffic_filtering=True,id=e9034327-6413-40df-842e-9ffbf58bb886,network=Network(b8c0f097-e9cb-4aa2-a925-da668439c435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9034327-64') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:09:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] attach device xml: <interface type="ethernet">
Nov 30 07:09:17 user nova-compute[75293]:   <mac address="fa:16:3e:8c:13:37"/>
Nov 30 07:09:17 user nova-compute[75293]:   <model type="virtio"/>
Nov 30 07:09:17 user nova-compute[75293]:   <mtu size="1442"/>
Nov 30 07:09:17 user nova-compute[75293]:   <target dev="tape9034327-64"/>
Nov 30 07:09:17 user nova-compute[75293]: </interface>
Nov 30 07:09:17 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9920807e-90a8-4c8f-a042-fd23637b3e69]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tFZdEixO {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tFZdEixO" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc047d7-d0b2-41ed-b2f4-e29057a01d64]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tFZdEixO'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e2e251-f6cf-46c3-8a0d-9a9ddecd76bf]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44351f7-0c50-4b95-8c53-2686b618ea76]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[015656c1-caf3-4052-b6a6-1d94a77537aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e, portal: 172.16.0.220,3260]
Nov 30 07:09:18 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e, portal: 172.16.0.220,3260] successful.
Nov 30 07:09:18 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71ac7fe-fa2d-4b60-907d-7c09eb675221]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1346c0d2-7271-4614-99a3-92d102fc330a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:18 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:18 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:18 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c302d05-4dce-4cc4-ae8c-ced250183326]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tFZdEixO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG nova.compute.manager [req-b038f2ed-e803-4c78-96b9-6b86c35ccf77 req-cfe613e2-e29d-4829-b040-f8caa507b643 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received event network-vif-plugged-e9034327-6413-40df-842e-9ffbf58bb886 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b038f2ed-e803-4c78-96b9-6b86c35ccf77 req-cfe613e2-e29d-4829-b040-f8caa507b643 service nova] Acquiring lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b038f2ed-e803-4c78-96b9-6b86c35ccf77 req-cfe613e2-e29d-4829-b040-f8caa507b643 service nova] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b038f2ed-e803-4c78-96b9-6b86c35ccf77 req-cfe613e2-e29d-4829-b040-f8caa507b643 service nova] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG nova.compute.manager [req-b038f2ed-e803-4c78-96b9-6b86c35ccf77 req-cfe613e2-e29d-4829-b040-f8caa507b643 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] No waiting events found dispatching network-vif-plugged-e9034327-6413-40df-842e-9ffbf58bb886 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:09:18 user nova-compute[75293]: WARNING nova.compute.manager [req-b038f2ed-e803-4c78-96b9-6b86c35ccf77 req-cfe613e2-e29d-4829-b040-f8caa507b643 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received unexpected event network-vif-plugged-e9034327-6413-40df-842e-9ffbf58bb886 for instance with vm_state active and task_state None.
Nov 30 07:09:18 user nova-compute[75293]: DEBUG nova.network.neutron [req-64a23a3d-ed06-4091-b3ee-136de1c3d567 req-cea2638b-af66-40ee-9c58-b1a5cb238ead service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Updated VIF entry in instance network info cache for port e9034327-6413-40df-842e-9ffbf58bb886. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG nova.network.neutron [req-64a23a3d-ed06-4091-b3ee-136de1c3d567 req-cea2638b-af66-40ee-9c58-b1a5cb238ead service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Updating instance_info_cache with network_info: [{"id": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "address": "fa:16:3e:2b:05:2c", "network": {"id": "ebc5494d-4e41-410c-a9ef-96a92a44d1d2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1004206243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4079c1bd-9b", "ovs_interfaceid": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9034327-6413-40df-842e-9ffbf58bb886", "address": "fa:16:3e:8c:13:37", "network": {"id": "b8c0f097-e9cb-4aa2-a925-da668439c435", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-656286509", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9034327-64", "ovs_interfaceid": "e9034327-6413-40df-842e-9ffbf58bb886", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-64a23a3d-ed06-4091-b3ee-136de1c3d567 req-cea2638b-af66-40ee-9c58-b1a5cb238ead service nova] Releasing lock "refresh_cache-67b8a66b-e7f8-41a1-8f5c-b29851ec608d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] No VIF found with MAC fa:16:3e:70:14:32, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8d0ce70a-6e1e-46b4-92bd-52c6918ca4ca tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.795s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] No BDM found with device name hda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] No VIF found with MAC fa:16:3e:2b:05:2c, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:09:18 user nova-compute[75293]:   <nova:package version="0.0.0"/>
Nov 30 07:09:18 user nova-compute[75293]:   <nova:name>tempest-device-tagging-server-448272992</nova:name>
Nov 30 07:09:18 user nova-compute[75293]:   <nova:creationTime>2023-11-30 07:09:18</nova:creationTime>
Nov 30 07:09:18 user nova-compute[75293]:   <nova:flavor name="m1.tiny">
Nov 30 07:09:18 user nova-compute[75293]:     <nova:memory>512</nova:memory>
Nov 30 07:09:18 user nova-compute[75293]:     <nova:disk>1</nova:disk>
Nov 30 07:09:18 user nova-compute[75293]:     <nova:swap>0</nova:swap>
Nov 30 07:09:18 user nova-compute[75293]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:09:18 user nova-compute[75293]:     <nova:vcpus>1</nova:vcpus>
Nov 30 07:09:18 user nova-compute[75293]:   </nova:flavor>
Nov 30 07:09:18 user nova-compute[75293]:   <nova:owner>
Nov 30 07:09:18 user nova-compute[75293]:     <nova:user uuid="d3af22daef9746c99424bf6581cc7608">tempest-TaggedAttachmentsTest-825521733-project-member</nova:user>
Nov 30 07:09:18 user nova-compute[75293]:     <nova:project uuid="67436111c10f475a9e2d249fe77f04c9">tempest-TaggedAttachmentsTest-825521733</nova:project>
Nov 30 07:09:18 user nova-compute[75293]:   </nova:owner>
Nov 30 07:09:18 user nova-compute[75293]:   <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:09:18 user nova-compute[75293]:   <nova:ports>
Nov 30 07:09:18 user nova-compute[75293]:     <nova:port uuid="4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e">
Nov 30 07:09:18 user nova-compute[75293]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 07:09:18 user nova-compute[75293]:     </nova:port>
Nov 30 07:09:18 user nova-compute[75293]:     <nova:port uuid="e9034327-6413-40df-842e-9ffbf58bb886">
Nov 30 07:09:18 user nova-compute[75293]:       <nova:ip type="fixed" address="10.10.10.52" ipVersion="4"/>
Nov 30 07:09:18 user nova-compute[75293]:     </nova:port>
Nov 30 07:09:18 user nova-compute[75293]:   </nova:ports>
Nov 30 07:09:18 user nova-compute[75293]: </nova:instance>
Nov 30 07:09:18 user nova-compute[75293]:  {{(pid=75293) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 30 07:09:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a1dafc2e-5772-4d15-a27e-24d7d210b548 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "interface-67b8a66b-e7f8-41a1-8f5c-b29851ec608d-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.066s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquiring lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG nova.objects.instance [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lazy-loading 'flavor' on Instance uuid 67b8a66b-e7f8-41a1-8f5c-b29851ec608d {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] <== connect_volume: return (2523ms) {'type': 'block', 'scsi_wwn': '23064313035626163', 'path': '/dev/sdi'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064313035626163', 'path': '/dev/sdi'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lazy-loading 'flavor' on Instance uuid bb71c604-7f7e-4b71-8fa3-56bd77b649c3 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Acquiring lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG os_brick.utils [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:09:19 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:09:19 user nova-compute[75293]:   <source dev="/dev/sdi"/>
Nov 30 07:09:19 user nova-compute[75293]:   <target dev="sdc" bus="scsi"/>
Nov 30 07:09:19 user nova-compute[75293]:   <serial>2196509e-eb26-4f38-a1d1-f0a42ad93e7e</serial>
Nov 30 07:09:19 user nova-compute[75293]:   <address type="drive" controller="0" unit="2"/>
Nov 30 07:09:19 user nova-compute[75293]: </disk>
Nov 30 07:09:19 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[36532748-4f86-4717-b459-08a4d1d1684c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[535e345a-13ed-412a-853e-3ae2ad0a0f8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df8804b-31f8-4cf5-af18-7fc9c2e86d87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1246b0-88c5-45e1-9073-7e7d8a8726e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:09:19 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf58c4f-d89d-4d5b-b1c8-e5a2bae553be]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG os_brick.utils [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquiring lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:19 user nova-compute[75293]: INFO nova.compute.manager [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Attaching volume 1c4ccece-1180-4a11-a9bc-696af4e09994 to /dev/vdb
Nov 30 07:09:19 user nova-compute[75293]: INFO nova.compute.manager [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Swapping volume 3a07d874-8250-4118-823e-acc286caf324 for 928456b8-83cb-449a-b7ec-630246aed685
Nov 30 07:09:19 user nova-compute[75293]: DEBUG os_brick.utils [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0a49a7-73b3-4d67-9e3f-b21d93997421]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbcddc9-93e9-49e0-be65-91983210588b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[49645773-1541-4486-90e9-ad4ba8dfa55b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a276e55-d89c-4c82-81a9-00334493c082]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:09:19 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:09:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9d5269-5704-4c65-a75d-115388119f5e]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG os_brick.utils [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Updating existing volume attachment record: 63483a9a-af23-474d-9fb9-676a92cc9dd6 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] No BDM found with device name sda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:09:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] No VIF found with MAC fa:16:3e:f7:a6:d9, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:09:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-db14cb3d-ad8d-4749-a6a5-4ba3908bf4f4 req-6b41d70b-2f61-4f13-b814-f8b79e835354 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received event network-vif-plugged-e9034327-6413-40df-842e-9ffbf58bb886 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-db14cb3d-ad8d-4749-a6a5-4ba3908bf4f4 req-6b41d70b-2f61-4f13-b814-f8b79e835354 service nova] Acquiring lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-db14cb3d-ad8d-4749-a6a5-4ba3908bf4f4 req-6b41d70b-2f61-4f13-b814-f8b79e835354 service nova] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-db14cb3d-ad8d-4749-a6a5-4ba3908bf4f4 req-6b41d70b-2f61-4f13-b814-f8b79e835354 service nova] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-db14cb3d-ad8d-4749-a6a5-4ba3908bf4f4 req-6b41d70b-2f61-4f13-b814-f8b79e835354 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] No waiting events found dispatching network-vif-plugged-e9034327-6413-40df-842e-9ffbf58bb886 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:09:20 user nova-compute[75293]: WARNING nova.compute.manager [req-db14cb3d-ad8d-4749-a6a5-4ba3908bf4f4 req-6b41d70b-2f61-4f13-b814-f8b79e835354 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received unexpected event network-vif-plugged-e9034327-6413-40df-842e-9ffbf58bb886 for instance with vm_state active and task_state None.
Nov 30 07:09:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NSbHMRYg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:21 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:21 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:21 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c9d532-1321-42d7-bee8-fa9c3bf15fbc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:09:21 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[47777265-6b96-4144-a4bb-736d36a3d01a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6] added
Nov 30 07:09:21 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c65fd1-ea8c-4cbc-b92c-5d920229cc35]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b374eec-13da-4d39-955d-b70788dd84f5]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NSbHMRYg {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NSbHMRYg" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c273dbfa-13e5-49f5-8fcc-6f7ad73ed26a]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NSbHMRYg'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8d03dd71-5f38-4ee4-ace8-a9ac827a4f8b tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.286s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[81adf78f-e006-43ca-9b82-f7c9f1b11314]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b41199a-c78b-4cc0-ab95-207a102c7cad]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:21 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:21 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d5fc16-85a7-4bb7-98e4-06fd3269b460]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6, portal: 172.16.0.220,3260]
Nov 30 07:09:21 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6, portal: 172.16.0.220,3260] successful.
Nov 30 07:09:21 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f86e052-a998-495a-bf1f-89d2e11b232e]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c166085-73dd-460b-8cf4-cc317a9259b5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:21 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:21 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:21 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d927acf2-af7c-4d69-b896-d6edab022ae4]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:09:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NSbHMRYg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:09:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Acquiring lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:22 user nova-compute[75293]: INFO nova.compute.manager [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Detaching volume 2196509e-eb26-4f38-a1d1-f0a42ad93e7e
Nov 30 07:09:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26639613634383866', 'path': '/dev/sdj'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639613634383866', 'path': '/dev/sdj'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:09:22 user nova-compute[75293]: DEBUG nova.objects.instance [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lazy-loading 'flavor' on Instance uuid 061832ab-930a-470b-8b4f-dfc8f19fea6b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:09:23 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:09:23 user nova-compute[75293]:   <source dev="/dev/sdj"/>
Nov 30 07:09:23 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:09:23 user nova-compute[75293]:   <serial>80aa03ff-3ad8-434f-909e-580680bb32a6</serial>
Nov 30 07:09:23 user nova-compute[75293]: </disk>
Nov 30 07:09:23 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:09:23 user nova-compute[75293]: INFO nova.virt.block_device [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Attempting to driver detach volume 2196509e-eb26-4f38-a1d1-f0a42ad93e7e from mountpoint /dev/sdc
Nov 30 07:09:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Attempting to detach device sdc from instance bb71c604-7f7e-4b71-8fa3-56bd77b649c3 from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:09:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:09:23 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:09:23 user nova-compute[75293]:   <source dev="/dev/sdi"/>
Nov 30 07:09:23 user nova-compute[75293]:   <target dev="sdc" bus="scsi"/>
Nov 30 07:09:23 user nova-compute[75293]:   <serial>2196509e-eb26-4f38-a1d1-f0a42ad93e7e</serial>
Nov 30 07:09:23 user nova-compute[75293]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 30 07:09:23 user nova-compute[75293]: </disk>
Nov 30 07:09:23 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:09:23 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Successfully detached device sdc from instance bb71c604-7f7e-4b71-8fa3-56bd77b649c3 from the persistent domain config.
Nov 30 07:09:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance bb71c604-7f7e-4b71-8fa3-56bd77b649c3 from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:09:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:09:23 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:09:23 user nova-compute[75293]:   <source dev="/dev/sdi"/>
Nov 30 07:09:23 user nova-compute[75293]:   <target dev="sdc" bus="scsi"/>
Nov 30 07:09:23 user nova-compute[75293]:   <serial>2196509e-eb26-4f38-a1d1-f0a42ad93e7e</serial>
Nov 30 07:09:23 user nova-compute[75293]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 30 07:09:23 user nova-compute[75293]: </disk>
Nov 30 07:09:23 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:09:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:09:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:09:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] No VIF found with MAC fa:16:3e:0a:7f:0a, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:09:23 user nova-compute[75293]: DEBUG nova.compute.manager [req-04a448d6-bf92-4767-abcf-a88c15a7f3fd req-2bfbb613-7b24-48f4-875d-e25ea385e746 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Received event network-changed-ca13e5bf-0c02-4a9d-b23f-079495c5a34f {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:23 user nova-compute[75293]: DEBUG nova.compute.manager [req-04a448d6-bf92-4767-abcf-a88c15a7f3fd req-2bfbb613-7b24-48f4-875d-e25ea385e746 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Refreshing instance network info cache due to event network-changed-ca13e5bf-0c02-4a9d-b23f-079495c5a34f. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:09:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-04a448d6-bf92-4767-abcf-a88c15a7f3fd req-2bfbb613-7b24-48f4-875d-e25ea385e746 service nova] Acquiring lock "refresh_cache-ca1e65f3-8696-4c9a-b4df-ce5923e1de31" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:09:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-04a448d6-bf92-4767-abcf-a88c15a7f3fd req-2bfbb613-7b24-48f4-875d-e25ea385e746 service nova] Acquired lock "refresh_cache-ca1e65f3-8696-4c9a-b4df-ce5923e1de31" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:09:23 user nova-compute[75293]: DEBUG nova.network.neutron [req-04a448d6-bf92-4767-abcf-a88c15a7f3fd req-2bfbb613-7b24-48f4-875d-e25ea385e746 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Refreshing network info cache for port ca13e5bf-0c02-4a9d-b23f-079495c5a34f {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:09:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-de263037-d477-4438-ae02-b5cda8f0a3c2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.151s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance bb71c604-7f7e-4b71-8fa3-56bd77b649c3 {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:09:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Acquiring lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:23 user nova-compute[75293]: DEBUG nova.objects.instance [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Lazy-loading 'flavor' on Instance uuid ca1e65f3-8696-4c9a-b4df-ce5923e1de31 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG nova.network.neutron [req-04a448d6-bf92-4767-abcf-a88c15a7f3fd req-2bfbb613-7b24-48f4-875d-e25ea385e746 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Updated VIF entry in instance network info cache for port ca13e5bf-0c02-4a9d-b23f-079495c5a34f. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG nova.network.neutron [req-04a448d6-bf92-4767-abcf-a88c15a7f3fd req-2bfbb613-7b24-48f4-875d-e25ea385e746 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Updating instance_info_cache with network_info: [{"id": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "address": "fa:16:3e:5a:44:78", "network": {"id": "1dfb2052-19d3-4cbe-9043-b01739b9b90e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-6334978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda1342c66f8477a830d140c3791d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca13e5bf-0c", "ovs_interfaceid": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-04a448d6-bf92-4767-abcf-a88c15a7f3fd req-2bfbb613-7b24-48f4-875d-e25ea385e746 service nova] Releasing lock "refresh_cache-ca1e65f3-8696-4c9a-b4df-ce5923e1de31" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Acquiring lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:24 user nova-compute[75293]: INFO nova.compute.manager [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Attaching volume e81a92be-a530-480e-ae80-cff4f154e9f4 to /dev/vdb
Nov 30 07:09:24 user nova-compute[75293]: DEBUG os_brick.utils [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[349a7936-daf0-4f92-b135-9dbb1801e7f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e5b4df-fad4-4308-bdb3-4f63a1f7193d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0103e655-9427-4a06-9729-a6a6c880a650]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac3d758-2c1b-4c7f-ba18-ce946617365d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:09:24 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:09:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f26ba7-9a6d-4a71-a8a3-9819a17c4123]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG os_brick.utils [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:24 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Updating existing volume attachment record: d3857cea-57fd-4d65-8596-eda318c9ef9f {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:09:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNkAxIqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:29 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:29 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:29 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:09:29 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kzHwhMjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dcd1ca28-3784-45b3-a3d3-e3231d8e82bb', 'attached_at': '', 'detached_at': '', 'volume_id': '928456b8-83cb-449a-b7ec-630246aed685', 'serial': '928456b8-83cb-449a-b7ec-630246aed685'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZzqkOjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'dcd1ca28-3784-45b3-a3d3-e3231d8e82bb', 'attached_at': '', 'detached_at': '', 'volume_id': '3a07d874-8250-4118-823e-acc286caf324', 'serial'} {{(pid=75293) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kzHwhMjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:29 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[805dfc01-a1c9-4428-a1dc-21ef04a0f7d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:09:29 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b68bab-2918-4bea-a525-67b4acc1859e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994] added
Nov 30 07:09:29 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd8d347-40af-4dd8-a74c-d5760302fedc]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[47883a77-06fb-4eee-84f2-1b604b067420]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eNkAxIqV {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eNkAxIqV" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9703aeaf-a899-47fe-9455-6673c8d4c389]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eNkAxIqV'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4633c97b-46f8-4078-8728-117968aa7a67]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e68f787-5d38-490d-9e4a-05d1a2411e89]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:29 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:29 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Acquiring lock "4ca1e46c-e83f-4476-a225-79e83151e222" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Lock "4ca1e46c-e83f-4476-a225-79e83151e222" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Acquiring lock "4ca1e46c-e83f-4476-a225-79e83151e222-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Lock "4ca1e46c-e83f-4476-a225-79e83151e222-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Lock "4ca1e46c-e83f-4476-a225-79e83151e222-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:29 user nova-compute[75293]: INFO nova.compute.manager [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Terminating instance
Nov 30 07:09:29 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8363f98-f321-4ac3-bd8f-8b242528f715]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994, portal: 172.16.0.220,3260]
Nov 30 07:09:29 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994, portal: 172.16.0.220,3260] successful.
Nov 30 07:09:29 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3d8eb5-1304-4446-857b-1a6f24bf1bd6]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4733491d-6bb0-42d8-8b59-a9d4bb5da66b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:29 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:29 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:29 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9744d775-b24b-4e6d-ab2f-f842457d80ec]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNkAxIqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "061832ab-930a-470b-8b4f-dfc8f19fea6b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:29 user nova-compute[75293]: INFO nova.compute.manager [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Detaching volume 80aa03ff-3ad8-434f-909e-580680bb32a6
Nov 30 07:09:29 user nova-compute[75293]: INFO nova.virt.block_device [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Attempting to driver detach volume 80aa03ff-3ad8-434f-909e-580680bb32a6 from mountpoint /dev/vdb
Nov 30 07:09:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Attempting to detach device vdb from instance 061832ab-930a-470b-8b4f-dfc8f19fea6b from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:09:29 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:09:29 user nova-compute[75293]:   <source dev="/dev/sdj"/>
Nov 30 07:09:29 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:09:29 user nova-compute[75293]:   <serial>80aa03ff-3ad8-434f-909e-580680bb32a6</serial>
Nov 30 07:09:29 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:09:29 user nova-compute[75293]: </disk>
Nov 30 07:09:29 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-15b88cf2-ba59-406a-82fa-315557506680 req-94c3bb57-e3ef-4a9d-b014-b2280e73508f service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Received event network-vif-unplugged-0a97402b-7eac-4b1f-9697-19a03235d6ec {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-15b88cf2-ba59-406a-82fa-315557506680 req-94c3bb57-e3ef-4a9d-b014-b2280e73508f service nova] Acquiring lock "4ca1e46c-e83f-4476-a225-79e83151e222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-15b88cf2-ba59-406a-82fa-315557506680 req-94c3bb57-e3ef-4a9d-b014-b2280e73508f service nova] Lock "4ca1e46c-e83f-4476-a225-79e83151e222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-15b88cf2-ba59-406a-82fa-315557506680 req-94c3bb57-e3ef-4a9d-b014-b2280e73508f service nova] Lock "4ca1e46c-e83f-4476-a225-79e83151e222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-15b88cf2-ba59-406a-82fa-315557506680 req-94c3bb57-e3ef-4a9d-b014-b2280e73508f service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] No waiting events found dispatching network-vif-unplugged-0a97402b-7eac-4b1f-9697-19a03235d6ec {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-15b88cf2-ba59-406a-82fa-315557506680 req-94c3bb57-e3ef-4a9d-b014-b2280e73508f service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Received event network-vif-unplugged-0a97402b-7eac-4b1f-9697-19a03235d6ec for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:09:29 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Successfully detached device vdb from instance 061832ab-930a-470b-8b4f-dfc8f19fea6b from the persistent domain config.
Nov 30 07:09:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 061832ab-930a-470b-8b4f-dfc8f19fea6b from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:09:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:09:29 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:09:29 user nova-compute[75293]:   <source dev="/dev/sdj"/>
Nov 30 07:09:29 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:09:29 user nova-compute[75293]:   <serial>80aa03ff-3ad8-434f-909e-580680bb32a6</serial>
Nov 30 07:09:29 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:09:29 user nova-compute[75293]: </disk>
Nov 30 07:09:29 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 061832ab-930a-470b-8b4f-dfc8f19fea6b {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23565373638363032', 'path': '/dev/sdk'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565373638363032', 'path': '/dev/sdk'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.429s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:30 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:30 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:09:30 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Instance destroyed successfully.
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Lazy-loading 'resources' on Instance uuid 4ca1e46c-e83f-4476-a225-79e83151e222 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG nova.objects.instance [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lazy-loading 'flavor' on Instance uuid 67b8a66b-e7f8-41a1-8f5c-b29851ec608d {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1290098302',display_name='tempest-VolumesActionsTest-instance-1290098302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1290098302',id=8,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:07:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='546752562a4b4dd8b72b8b5a50b94edf',ramdisk_id='',reservation_id='r-rdsb7bov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-268994549',owner_user_name='tempest-VolumesActionsTest-268994549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:07:36Z,user_data=None,user_id='2def2c5e09d34daba7b1999f2ca2a2b2',uuid=4ca1e46c-e83f-4476-a225-79e83151e222,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "address": "fa:16:3e:5e:78:b6", "network": {"id": "7dd319d3-1085-4cd1-a711-d807a563714b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-616822404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546752562a4b4dd8b72b8b5a50b94edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a97402b-7e", "ovs_interfaceid": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Converting VIF {"id": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "address": "fa:16:3e:5e:78:b6", "network": {"id": "7dd319d3-1085-4cd1-a711-d807a563714b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-616822404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "546752562a4b4dd8b72b8b5a50b94edf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a97402b-7e", "ovs_interfaceid": "0a97402b-7eac-4b1f-9697-19a03235d6ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:78:b6,bridge_name='br-int',has_traffic_filtering=True,id=0a97402b-7eac-4b1f-9697-19a03235d6ec,network=Network(7dd319d3-1085-4cd1-a711-d807a563714b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a97402b-7e') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_vif [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:78:b6,bridge_name='br-int',has_traffic_filtering=True,id=0a97402b-7eac-4b1f-9697-19a03235d6ec,network=Network(7dd319d3-1085-4cd1-a711-d807a563714b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a97402b-7e') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[408f4ad5-183a-4877-ac87-1eca4fcd9d7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:09:30 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a97402b-7e, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:09:30 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:09:30 user nova-compute[75293]:   <source dev="/dev/sdk"/>
Nov 30 07:09:30 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:09:30 user nova-compute[75293]:   <serial>1c4ccece-1180-4a11-a9bc-696af4e09994</serial>
Nov 30 07:09:30 user nova-compute[75293]: </disk>
Nov 30 07:09:30 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27774166-39d7-4c73-aa39-f3721fb547e6) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b9fb60-5d66-4b5c-a32d-d37fdf5943f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685] added
Nov 30 07:09:30 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:30 user nova-compute[75293]: INFO os_vif [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:78:b6,bridge_name='br-int',has_traffic_filtering=True,id=0a97402b-7eac-4b1f-9697-19a03235d6ec,network=Network(7dd319d3-1085-4cd1-a711-d807a563714b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a97402b-7e')
Nov 30 07:09:30 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Deleting instance files /opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222_del
Nov 30 07:09:30 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Deletion of /opt/stack/data/nova/instances/4ca1e46c-e83f-4476-a225-79e83151e222_del complete
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[db343655-6ee9-4304-b9a1-4bfe3cf87591]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bac42dc-4dec-45e0-9a3f-583e8737c0e8]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kzHwhMjp {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kzHwhMjp" returned: 0 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf3c1f8-6b87-4d43-a623-579d2dc188f5]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kzHwhMjp'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:30 user nova-compute[75293]: INFO nova.compute.manager [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb28ced3-5db3-4163-98ac-5ee991aee9a3]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0682ac-6720-4b40-b9a4-a226b1580420]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:30 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:30 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[03897755-d4f7-499c-b4be-2fe9d85adb1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685, portal: 172.16.0.220,3260]
Nov 30 07:09:30 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685, portal: 172.16.0.220,3260] successful.
Nov 30 07:09:30 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3040fbf-638f-45f2-a741-b6dcfe015c61]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a76d449-3de8-4624-8b44-9c7f68d9e323]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:30 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:30 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:30 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] HCTL ('43', '-', '-', 0) found on session 12 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0744167e-cedd-4486-ba68-98bffb5a1860]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Searching for a device in session 12 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:09:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kzHwhMjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:09:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:09:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] No BDM found with device name hda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:09:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] No VIF found with MAC fa:16:3e:2b:05:2c, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:09:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-316c0c18-952c-4b2e-ba43-20df10899c4b tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.666s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:31 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:09:31 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Took 0.58 seconds to deallocate network for instance.
Nov 30 07:09:31 user nova-compute[75293]: DEBUG nova.compute.manager [req-aeddb347-4248-4db9-8b23-6a31594c127f req-eb1252b1-6c85-4cb0-adb8-b2a8128655e0 service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Received event network-vif-deleted-0a97402b-7eac-4b1f-9697-19a03235d6ec {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:31 user nova-compute[75293]: INFO nova.compute.manager [req-aeddb347-4248-4db9-8b23-6a31594c127f req-eb1252b1-6c85-4cb0-adb8-b2a8128655e0 service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Neutron deleted interface 0a97402b-7eac-4b1f-9697-19a03235d6ec; detaching it from the instance and deleting it from the info cache
Nov 30 07:09:31 user nova-compute[75293]: DEBUG nova.network.neutron [req-aeddb347-4248-4db9-8b23-6a31594c127f req-eb1252b1-6c85-4cb0-adb8-b2a8128655e0 service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:09:31 user nova-compute[75293]: DEBUG nova.compute.manager [req-aeddb347-4248-4db9-8b23-6a31594c127f req-eb1252b1-6c85-4cb0-adb8-b2a8128655e0 service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Detach interface failed, port_id=0a97402b-7eac-4b1f-9697-19a03235d6ec, reason: Instance 4ca1e46c-e83f-4476-a225-79e83151e222 could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:09:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:31 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:09:31 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:09:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:31 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Deleted allocations for instance 4ca1e46c-e83f-4476-a225-79e83151e222
Nov 30 07:09:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8cc5d518-3b09-4ad2-ab5f-55b7831b3369 tempest-VolumesActionsTest-268994549 tempest-VolumesActionsTest-268994549-project-member] Lock "4ca1e46c-e83f-4476-a225-79e83151e222" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.459s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:31 user nova-compute[75293]: DEBUG nova.compute.manager [req-df43795a-3774-45ee-b808-f89eaa766eb2 req-05aea64f-2155-4e25-a6ed-4c97f1ea8b30 service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Received event network-vif-plugged-0a97402b-7eac-4b1f-9697-19a03235d6ec {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-df43795a-3774-45ee-b808-f89eaa766eb2 req-05aea64f-2155-4e25-a6ed-4c97f1ea8b30 service nova] Acquiring lock "4ca1e46c-e83f-4476-a225-79e83151e222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-df43795a-3774-45ee-b808-f89eaa766eb2 req-05aea64f-2155-4e25-a6ed-4c97f1ea8b30 service nova] Lock "4ca1e46c-e83f-4476-a225-79e83151e222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-df43795a-3774-45ee-b808-f89eaa766eb2 req-05aea64f-2155-4e25-a6ed-4c97f1ea8b30 service nova] Lock "4ca1e46c-e83f-4476-a225-79e83151e222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:31 user nova-compute[75293]: DEBUG nova.compute.manager [req-df43795a-3774-45ee-b808-f89eaa766eb2 req-05aea64f-2155-4e25-a6ed-4c97f1ea8b30 service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] No waiting events found dispatching network-vif-plugged-0a97402b-7eac-4b1f-9697-19a03235d6ec {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:09:31 user nova-compute[75293]: WARNING nova.compute.manager [req-df43795a-3774-45ee-b808-f89eaa766eb2 req-05aea64f-2155-4e25-a6ed-4c97f1ea8b30 service nova] [instance: 4ca1e46c-e83f-4476-a225-79e83151e222] Received unexpected event network-vif-plugged-0a97402b-7eac-4b1f-9697-19a03235d6ec for instance with vm_state deleted and task_state None.
Nov 30 07:09:31 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:31 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] <== connect_volume: return (2871ms) {'type': 'block', 'scsi_wwn': '23833313666313661', 'path': '/dev/sdl'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833313666313661', 'path': '/dev/sdl'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:09:31 user nova-compute[75293]: DEBUG nova.objects.instance [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Lazy-loading 'flavor' on Instance uuid dcd1ca28-3784-45b3-a3d3-e3231d8e82bb {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquiring lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:32 user nova-compute[75293]: INFO nova.compute.manager [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Detaching volume 1c4ccece-1180-4a11-a9bc-696af4e09994
Nov 30 07:09:32 user nova-compute[75293]: INFO nova.virt.block_device [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Attempting to driver detach volume 1c4ccece-1180-4a11-a9bc-696af4e09994 from mountpoint /dev/vdb
Nov 30 07:09:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Attempting to detach device vdb from instance 67b8a66b-e7f8-41a1-8f5c-b29851ec608d from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:09:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:09:32 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:09:32 user nova-compute[75293]:   <source dev="/dev/sdk"/>
Nov 30 07:09:32 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:09:32 user nova-compute[75293]:   <serial>1c4ccece-1180-4a11-a9bc-696af4e09994</serial>
Nov 30 07:09:32 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 07:09:32 user nova-compute[75293]: </disk>
Nov 30 07:09:32 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:09:32 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Successfully detached device vdb from instance 67b8a66b-e7f8-41a1-8f5c-b29851ec608d from the persistent domain config.
Nov 30 07:09:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 67b8a66b-e7f8-41a1-8f5c-b29851ec608d from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:09:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:09:32 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:09:32 user nova-compute[75293]:   <source dev="/dev/sdk"/>
Nov 30 07:09:32 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:09:32 user nova-compute[75293]:   <serial>1c4ccece-1180-4a11-a9bc-696af4e09994</serial>
Nov 30 07:09:32 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 07:09:32 user nova-compute[75293]: </disk>
Nov 30 07:09:32 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:09:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:09:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 67b8a66b-e7f8-41a1-8f5c-b29851ec608d {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:09:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] COPY block job progress, current cursor: 138412032 final cursor: 1073741824 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:09:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] COPY block job progress, current cursor: 210763776 final cursor: 1073741824 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:09:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] COPY block job progress, current cursor: 348127232 final cursor: 1073741824 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] COPY block job progress, current cursor: 456130560 final cursor: 1073741824 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsmaQekr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:34 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:34 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:34 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:09:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19901b2-ef35-43d5-a0f7-95c9ab6837ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:09:34 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e508786-8663-4d0a-9b1f-665a3a5c42be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4] added
Nov 30 07:09:34 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab5dc28-ce80-4b8c-83c2-432e3f422f2f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0594ec72-e450-407b-9c56-830e268502f4]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VsmaQekr {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VsmaQekr" returned: 0 in 0.030s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c98b73e-afb7-46e8-a37e-93d9450944a6]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VsmaQekr'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] COPY block job progress, current cursor: 623902720 final cursor: 1073741824 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfd1350-4159-4f14-b47f-b0649c2af696]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[565a1392-8c07-4ede-9ca8-690b2ad3ed81]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.304s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[965ad6b0-3c4c-42c2-8428-7d23043c196d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4, portal: 172.16.0.220,3260]
Nov 30 07:09:35 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4, portal: 172.16.0.220,3260] successful.
Nov 30 07:09:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d600bfa3-cabb-4411-b3cd-77eb31698cee]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[acaa2f70-a381-4c7d-8cbe-af520ea7a9af]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:35 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.630s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] HCTL ('44', '-', '-', 0) found on session 13 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Scanning host 44 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d39388a-d2e4-4dfa-8afa-cba59382080f]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Searching for a device in session 13 and hctl ['44', '*', '*', 0] yield: None {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] COPY block job progress, current cursor: 708837376 final cursor: 1073741824 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] COPY block job progress, current cursor: 878706688 final cursor: 1073741824 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:09:36 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Searching for a device in session 13 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:09:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsmaQekr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:09:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.667s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] <== connect_volume: return (1669ms) {'type': 'block', 'scsi_wwn': '23737386333363862', 'path': '/dev/sdm'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:36 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737386333363862', 'path': '/dev/sdm'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:09:36 user nova-compute[75293]: DEBUG nova.objects.instance [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Lazy-loading 'flavor' on Instance uuid ca1e65f3-8696-4c9a-b4df-ce5923e1de31 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:36 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] COPY block job progress, current cursor: 979369984 final cursor: 1073741824 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:09:36 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] attach device xml: <disk type="block" device="disk">
Nov 30 07:09:36 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:09:36 user nova-compute[75293]:   <source dev="/dev/sdm"/>
Nov 30 07:09:36 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:09:36 user nova-compute[75293]:   <serial>e81a92be-a530-480e-ae80-cff4f154e9f4</serial>
Nov 30 07:09:36 user nova-compute[75293]: </disk>
Nov 30 07:09:36 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:09:36 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:09:36 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:09:36 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] No VIF found with MAC fa:16:3e:5a:44:78, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:09:36 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-932dda66-bfda-4c24-8009-db01ddc39df3 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.785s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZzqkOjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:37 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d47f82-c11c-4564-9cc6-da2759af3a73]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:09:37 user nova-compute[75293]: No targets found.
Nov 30 07:09:37 user nova-compute[75293]: iSNS:
Nov 30 07:09:37 user nova-compute[75293]: No targets found.
Nov 30 07:09:37 user nova-compute[75293]: STATIC:
Nov 30 07:09:37 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765
Nov 30 07:09:37 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:37 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:37 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685
Nov 30 07:09:37 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:37 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:37 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994
Nov 30 07:09:37 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:37 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:37 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6
Nov 30 07:09:37 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:37 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:37 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c
Nov 30 07:09:37 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:37 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:37 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89
Nov 30 07:09:37 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:37 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:37 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4
Nov 30 07:09:37 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:37 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:37 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50
Nov 30 07:09:37 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:37 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:37 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14
Nov 30 07:09:37 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:37 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:37 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e
Nov 30 07:09:37 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:37 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:37 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51
Nov 30 07:09:37 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:37 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:37 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324
Nov 30 07:09:37 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:37 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:37 user nova-compute[75293]: FIRMWARE:
Nov 30 07:09:37 user nova-compute[75293]: No targets found.
Nov 30 07:09:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:09:37 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:09:37 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6f30d8-d324-4f20-a89a-af7317a6f70b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ee7847-4909-4dcd-8ffc-f8de01f36270]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:37 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe8077eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324'): ({'sdh'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Removing single pathed devices sdh {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb9d25b-0b20-4a6f-ae74-941029417bb2]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b24cee-6dc7-40cb-abc7-b0a75f7103ef]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Flushing IO for device /dev/sdh {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bdf771-aa49-4467-9e63-0e1379effaba]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6532400-3d7d-4912-8bb5-8bfc7a4af449]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] SCSI volumes sdh have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[179c9aba-6a2f-4d08-85b9-753eea2aae05]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea01a82-4d57-466a-8fdb-a5a6255e48af]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324, portal: 172.16.0.220,3260]
Nov 30 07:09:37 user nova-compute[75293]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324, portal: 172.16.0.220,3260] successful.
Nov 30 07:09:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4862e44-492e-4ca1-bead-b6089b233778]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] <== disconnect_volume: return (364ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kzHwhMjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, 'status': 'reserved', 'instance': 'dcd1ca28-3784-45b3-a3d3-e3231d8e82bb', 'attached_at': '', 'detached_at': '', 'volume_id': '928456b8-83cb-449a-b7ec-630246aed685', 'serial'} {{(pid=75293) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 30 07:09:37 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] swap_volume: removing Cinder connection for volume 3a07d874-8250-4118-823e-acc286caf324 {{(pid=75293) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 30 07:09:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d26294da-0338-4688-aefb-a5ffbf1dcc6a tempest-VolumesAssistedSnapshotsTest-600607993 tempest-VolumesAssistedSnapshotsTest-600607993-project] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] volume_snapshot_create: create_info: {'snapshot_id': '8599d820-1de3-4141-b72d-04843b21a195', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75293) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 30 07:09:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d26294da-0338-4688-aefb-a5ffbf1dcc6a tempest-VolumesAssistedSnapshotsTest-600607993 tempest-VolumesAssistedSnapshotsTest-600607993-project] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] snap xml: <domainsnapshot>
Nov 30 07:09:38 user nova-compute[75293]:   <disks>
Nov 30 07:09:38 user nova-compute[75293]:     <disk name="/dev/sdm" snapshot="external" type="file">
Nov 30 07:09:38 user nova-compute[75293]:       <source file="/dev/new_file"/>
Nov 30 07:09:38 user nova-compute[75293]:     </disk>
Nov 30 07:09:38 user nova-compute[75293]:     <disk name="vda" snapshot="no"/>
Nov 30 07:09:38 user nova-compute[75293]:   </disks>
Nov 30 07:09:38 user nova-compute[75293]: </domainsnapshot>
Nov 30 07:09:38 user nova-compute[75293]:  {{(pid=75293) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 30 07:09:38 user nova-compute[75293]: DEBUG nova.objects.instance [None req-d26294da-0338-4688-aefb-a5ffbf1dcc6a tempest-VolumesAssistedSnapshotsTest-600607993 tempest-VolumesAssistedSnapshotsTest-600607993-project] Lazy-loading 'system_metadata' on Instance uuid ca1e65f3-8696-4c9a-b4df-ce5923e1de31 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:38 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-d26294da-0338-4688-aefb-a5ffbf1dcc6a tempest-VolumesAssistedSnapshotsTest-600607993 tempest-VolumesAssistedSnapshotsTest-600607993-project] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 07:09:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6fc8e1a0-39d5-4a61-956f-ebb1a7b89e2c tempest-VolumesAssistedSnapshotsTest-600607993 tempest-VolumesAssistedSnapshotsTest-600607993-project] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] volume_snapshot_delete: delete_info: {'volume_id': 'e81a92be-a530-480e-ae80-cff4f154e9f4'} {{(pid=75293) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [None req-6fc8e1a0-39d5-4a61-956f-ebb1a7b89e2c tempest-VolumesAssistedSnapshotsTest-600607993 tempest-VolumesAssistedSnapshotsTest-600607993-project] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Traceback (most recent call last):
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]     if delete_info['type'] != 'qcow2':
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] KeyError: 'type'
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] 
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [None req-d26294da-0338-4688-aefb-a5ffbf1dcc6a tempest-VolumesAssistedSnapshotsTest-600607993 tempest-VolumesAssistedSnapshotsTest-600607993-project] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Traceback (most recent call last):
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]     rv = execute(f, *args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]     six.reraise(c, e, tb)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]     raise value
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]     rv = meth(*args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] 
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [None req-d26294da-0338-4688-aefb-a5ffbf1dcc6a tempest-VolumesAssistedSnapshotsTest-600607993 tempest-VolumesAssistedSnapshotsTest-600607993-project] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Traceback (most recent call last):
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]     self._volume_snapshot_create(context, instance, guest,
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]     rv = execute(f, *args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]     six.reraise(c, e, tb)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]     raise value
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]     rv = meth(*args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] 
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [None req-6fc8e1a0-39d5-4a61-956f-ebb1a7b89e2c tempest-VolumesAssistedSnapshotsTest-600607993 tempest-VolumesAssistedSnapshotsTest-600607993-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver 
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver 
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-040862b5-7deb-473b-b766-ebb7bd4958c0)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver 
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver 
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver 
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server [None req-6fc8e1a0-39d5-4a61-956f-ebb1a7b89e2c tempest-VolumesAssistedSnapshotsTest-600607993 tempest-VolumesAssistedSnapshotsTest-600607993-project] Exception during message handling: KeyError: 'type'
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server 
Nov 30 07:09:38 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] swap_volume: Updating volume 3a07d874-8250-4118-823e-acc286caf324 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "kzHwhMjp", "auth_password": "Gpaguc3jCDI7Mx", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdl", "volume_id": "928456b8-83cb-449a-b7ec-630246aed685"}, "status": "reserved", "instance": "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb", "attached_at": "", "detached_at": "", "volume_id": "928456b8-83cb-449a-b7ec-630246aed685", "serial": "928456b8-83cb-449a-b7ec-630246aed685"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '928456b8-83cb-449a-b7ec-630246aed685', 'no_device': None, 'attachment_id': '4aab762f-52bb-495f-8f0d-748e1dcc675d'} {{(pid=75293) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 30 07:09:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b3def42e-93ac-4d54-8abb-01780a69a530 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.041s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver [None req-d26294da-0338-4688-aefb-a5ffbf1dcc6a tempest-VolumesAssistedSnapshotsTest-600607993 tempest-VolumesAssistedSnapshotsTest-600607993-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 8599d820-1de3-4141-b72d-04843b21a195 could not be found.
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     raise value
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver 
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver 
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 8599d820-1de3-4141-b72d-04843b21a195 could not be found. (HTTP 404) (Request-ID: req-9576d0fd-39e1-42c7-a26b-1431452b2d75)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver 
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver 
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 8599d820-1de3-4141-b72d-04843b21a195 could not be found.
Nov 30 07:09:38 user nova-compute[75293]: ERROR nova.virt.libvirt.driver 
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server [None req-d26294da-0338-4688-aefb-a5ffbf1dcc6a tempest-VolumesAssistedSnapshotsTest-600607993 tempest-VolumesAssistedSnapshotsTest-600607993-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     raise value
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 30 07:09:38 user nova-compute[75293]: ERROR oslo_messaging.rpc.server 
Nov 30 07:09:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Acquiring lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:38 user nova-compute[75293]: INFO nova.compute.manager [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Detaching volume e81a92be-a530-480e-ae80-cff4f154e9f4
Nov 30 07:09:38 user nova-compute[75293]: INFO nova.virt.block_device [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Attempting to driver detach volume e81a92be-a530-480e-ae80-cff4f154e9f4 from mountpoint /dev/vdb
Nov 30 07:09:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Attempting to detach device vdb from instance ca1e65f3-8696-4c9a-b4df-ce5923e1de31 from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:09:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] detach device xml: <disk type="block" device="disk">
Nov 30 07:09:38 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:09:38 user nova-compute[75293]:   <source dev="/dev/sdm"/>
Nov 30 07:09:38 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:09:38 user nova-compute[75293]:   <serial>e81a92be-a530-480e-ae80-cff4f154e9f4</serial>
Nov 30 07:09:38 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:09:38 user nova-compute[75293]: </disk>
Nov 30 07:09:38 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:09:38 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Successfully detached device vdb from instance ca1e65f3-8696-4c9a-b4df-ce5923e1de31 from the persistent domain config.
Nov 30 07:09:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ca1e65f3-8696-4c9a-b4df-ce5923e1de31 from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:09:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] detach device xml: <disk type="block" device="disk">
Nov 30 07:09:38 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:09:38 user nova-compute[75293]:   <source dev="/dev/sdm"/>
Nov 30 07:09:38 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:09:38 user nova-compute[75293]:   <serial>e81a92be-a530-480e-ae80-cff4f154e9f4</serial>
Nov 30 07:09:38 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:09:38 user nova-compute[75293]: </disk>
Nov 30 07:09:38 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ca1e65f3-8696-4c9a-b4df-ce5923e1de31 {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Acquiring lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG os_brick.utils [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[406f69ea-5070-447a-9ea4-d3294eb39d8d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc77cc7-c10f-49e3-9e64-a7074048167c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc26bc02-9c4e-4b04-ae38-561aa2fce32a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8880e9c2-ebb2-4142-900a-87f73a20b8f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:09:39 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:09:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4644f12-947e-4530-a153-5539e407b53a]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:09:39 user nova-compute[75293]: DEBUG os_brick.utils [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:39 user nova-compute[75293]: INFO nova.compute.manager [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Swapping volume 928456b8-83cb-449a-b7ec-630246aed685 for 3a07d874-8250-4118-823e-acc286caf324
Nov 30 07:09:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:43 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance bb71c604-7f7e-4b71-8fa3-56bd77b649c3 is timed out.
Nov 30 07:09:43 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Successfully detached device sdc from instance bb71c604-7f7e-4b71-8fa3-56bd77b649c3 from the live domain config.
Nov 30 07:09:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tFZdEixO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:43 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88e367e-5175-49f8-8e5e-35f651b19a97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:09:43 user nova-compute[75293]: No targets found.
Nov 30 07:09:43 user nova-compute[75293]: iSNS:
Nov 30 07:09:43 user nova-compute[75293]: No targets found.
Nov 30 07:09:43 user nova-compute[75293]: STATIC:
Nov 30 07:09:43 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765
Nov 30 07:09:43 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:43 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:43 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685
Nov 30 07:09:43 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:43 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:43 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994
Nov 30 07:09:43 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:43 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:43 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6
Nov 30 07:09:43 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:43 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:43 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c
Nov 30 07:09:43 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:43 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:43 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89
Nov 30 07:09:43 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:43 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:43 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4
Nov 30 07:09:43 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:43 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:43 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50
Nov 30 07:09:43 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:43 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:43 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14
Nov 30 07:09:43 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:43 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:43 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e
Nov 30 07:09:43 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:43 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:43 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51
Nov 30 07:09:43 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:43 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:43 user nova-compute[75293]: FIRMWARE:
Nov 30 07:09:43 user nova-compute[75293]: No targets found.
Nov 30 07:09:43 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:09:43 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:09:43 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5396cf48-92ef-448e-b142-fc023be14125]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1397bba4-3cd2-4dfb-ba64-c04561e58645]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:43 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:43 user nova-compute[75293]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e (non-flash)
Nov 30 07:09:43 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effc87be560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e'): ({'sdi'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Removing single pathed devices sdi {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d94bb5-93b4-4fb2-8192-d6d1ca057488]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[338857ba-32fd-42ba-ab02-6cdfa34e1291]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Flushing IO for device /dev/sdi {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17bb685-5692-4cbb-b742-e282b746ff87]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:09:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.040s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb14f85-898d-4364-a863-f822514acd7c]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] SCSI volumes sdi have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbdb08e-3153-4525-9b36-96d2dd6041cc]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b1af7b-d50e-4c97-afd5-6b5511ea1545]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e, portal: 172.16.0.220,3260]
Nov 30 07:09:44 user nova-compute[75293]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e, portal: 172.16.0.220,3260] successful.
Nov 30 07:09:44 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2196509e-eb26-4f38-a1d1-f0a42ad93e7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8eaaeb-2883-4973-9b62-a14c02df4c81]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] <== disconnect_volume: return (376ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:44 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:09:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG nova.objects.instance [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lazy-loading 'flavor' on Instance uuid bb71c604-7f7e-4b71-8fa3-56bd77b649c3 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5d022a27-0a2d-4c68-8a13-f994bcf04bb3 tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.558s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZzqkOjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dcd1ca28-3784-45b3-a3d3-e3231d8e82bb', 'attached_at': '', 'detached_at': '', 'volume_id': '3a07d874-8250-4118-823e-acc286caf324', 'serial': '3a07d874-8250-4118-823e-acc286caf324'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kzHwhMjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '928456b8-83cb-449a-b7ec-630246aed685'}, 'status': 'reserved', 'instance': 'dcd1ca28-3784-45b3-a3d3-e3231d8e82bb', 'attached_at': '', 'detached_at': '', 'volume_id': '928456b8-83cb-449a-b7ec-630246aed685', 'serial'} {{(pid=75293) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZzqkOjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:49 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:49 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:49 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd808c6-83d1-4255-8e57-d8c224ac28de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:09:49 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d082a19c-5423-480e-9fac-a3f89d6ad91b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324] added
Nov 30 07:09:49 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafb1b59-21b4-4f39-80cf-6092b588a4ef]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9271ee2-e2f3-4843-9474-9b69b8d8f953]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZzqkOjK {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZzqkOjK" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b474772d-1352-43e1-9f25-fe6830ee64a5]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dZzqkOjK'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6002372c-1fcd-424b-b132-eb1ac51dad33]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a38913a-8ac6-4e9a-b5ab-fde2040e9b8e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[102622db-8ba3-4c77-8a53-d25ff16e0f6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324, portal: 172.16.0.220,3260]
Nov 30 07:09:49 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324, portal: 172.16.0.220,3260] successful.
Nov 30 07:09:49 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6cb5d5-a940-496b-9b83-3daf42824a47]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c0b4ef-74b7-4737-9c42-93f46c24ce61]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:49 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] HCTL ('39', '-', '-', 0) found on session 14 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-bb71c604-7f7e-4b71-8fa3-56bd77b649c3" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-bb71c604-7f7e-4b71-8fa3-56bd77b649c3" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f740b43d-87a8-4e7d-8c06-b2fb46a70f5a]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Searching for a device in session 14 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZzqkOjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Acquiring lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Acquiring lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:49 user nova-compute[75293]: INFO nova.compute.manager [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Terminating instance
Nov 30 07:09:49 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG nova.compute.manager [req-634be504-66ee-49f8-a095-ec2685437e8e req-e7837b53-b257-4061-8eeb-660acadfe4d3 service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Received event network-vif-unplugged-53964f53-7286-4710-bc56-709f3d460ba2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-634be504-66ee-49f8-a095-ec2685437e8e req-e7837b53-b257-4061-8eeb-660acadfe4d3 service nova] Acquiring lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-634be504-66ee-49f8-a095-ec2685437e8e req-e7837b53-b257-4061-8eeb-660acadfe4d3 service nova] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-634be504-66ee-49f8-a095-ec2685437e8e req-e7837b53-b257-4061-8eeb-660acadfe4d3 service nova] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG nova.compute.manager [req-634be504-66ee-49f8-a095-ec2685437e8e req-e7837b53-b257-4061-8eeb-660acadfe4d3 service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] No waiting events found dispatching network-vif-unplugged-53964f53-7286-4710-bc56-709f3d460ba2 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG nova.compute.manager [req-634be504-66ee-49f8-a095-ec2685437e8e req-e7837b53-b257-4061-8eeb-660acadfe4d3 service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Received event network-vif-unplugged-53964f53-7286-4710-bc56-709f3d460ba2 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Updating instance_info_cache with network_info: [{"id": "53964f53-7286-4710-bc56-709f3d460ba2", "address": "fa:16:3e:f7:a6:d9", "network": {"id": "3a2529a8-0610-4c6a-8844-84b457a6e027", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1879734062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2dd909b1384539ac2fa74ece5501f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53964f53-72", "ovs_interfaceid": "53964f53-7286-4710-bc56-709f3d460ba2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-bb71c604-7f7e-4b71-8fa3-56bd77b649c3" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:09:50 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 061832ab-930a-470b-8b4f-dfc8f19fea6b is timed out.
Nov 30 07:09:50 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Successfully detached device vdb from instance 061832ab-930a-470b-8b4f-dfc8f19fea6b from the live domain config.
Nov 30 07:09:50 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NSbHMRYg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:50 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:50 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Instance destroyed successfully.
Nov 30 07:09:50 user nova-compute[75293]: DEBUG nova.objects.instance [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lazy-loading 'resources' on Instance uuid bb71c604-7f7e-4b71-8fa3-56bd77b649c3 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-384242228',display_name='tempest-AttachSCSIVolumeTestJSON-server-384242228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-384242228',id=4,image_ref='3bbfba9e-7023-48a8-87f3-49f8c7d1ac27',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEB4DdRyKUH8rA6Sm+odCzPLcFyMIGAUoYhVLgX2CbXaozUldlryipSJ5qwH1YT4pB+ZJ2fuL71tCKnJIq/6GjOvzfv+QB5mzXLHSCNLXFbMCG5vVAIkX5aCCW5H1vIvzQ==',key_name='tempest-keypair-1461044521',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:07:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d2dd909b1384539ac2fa74ece5501f2',ramdisk_id='',reservation_id='r-ib7jor2j',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3bbfba9e-7023-48a8-87f3-49f8c7d1ac27',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-753889653',owner_user_name='tempest-AttachSCSIVolumeTestJSON-753889653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:07:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302dc033f6814d5297e9fdaf59b1c5e7',uuid=bb71c604-7f7e-4b71-8fa3-56bd77b649c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53964f53-7286-4710-bc56-709f3d460ba2", "address": "fa:16:3e:f7:a6:d9", "network": {"id": "3a2529a8-0610-4c6a-8844-84b457a6e027", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1879734062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2dd909b1384539ac2fa74ece5501f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53964f53-72", "ovs_interfaceid": "53964f53-7286-4710-bc56-709f3d460ba2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Converting VIF {"id": "53964f53-7286-4710-bc56-709f3d460ba2", "address": "fa:16:3e:f7:a6:d9", "network": {"id": "3a2529a8-0610-4c6a-8844-84b457a6e027", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1879734062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d2dd909b1384539ac2fa74ece5501f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53964f53-72", "ovs_interfaceid": "53964f53-7286-4710-bc56-709f3d460ba2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:a6:d9,bridge_name='br-int',has_traffic_filtering=True,id=53964f53-7286-4710-bc56-709f3d460ba2,network=Network(3a2529a8-0610-4c6a-8844-84b457a6e027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53964f53-72') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG os_vif [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:a6:d9,bridge_name='br-int',has_traffic_filtering=True,id=53964f53-7286-4710-bc56-709f3d460ba2,network=Network(3a2529a8-0610-4c6a-8844-84b457a6e027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53964f53-72') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53964f53-72, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd28903a-3ddf-4dfe-8eb9-7f281b454ccf) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:50 user nova-compute[75293]: INFO os_vif [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:a6:d9,bridge_name='br-int',has_traffic_filtering=True,id=53964f53-7286-4710-bc56-709f3d460ba2,network=Network(3a2529a8-0610-4c6a-8844-84b457a6e027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53964f53-72')
Nov 30 07:09:50 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Deleting instance files /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3_del
Nov 30 07:09:50 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Deletion of /opt/stack/data/nova/instances/bb71c604-7f7e-4b71-8fa3-56bd77b649c3_del complete
Nov 30 07:09:50 user nova-compute[75293]: INFO nova.compute.manager [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:09:50 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Error from libvirt while getting description of instance-00000004: [Error Code 42] Domain not found: no domain with matching uuid 'bb71c604-7f7e-4b71-8fa3-56bd77b649c3' (instance-00000004): libvirt.libvirtError: Domain not found: no domain with matching uuid 'bb71c604-7f7e-4b71-8fa3-56bd77b649c3' (instance-00000004)
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] <== connect_volume: return (1453ms) {'type': 'block', 'scsi_wwn': '26233336133313363', 'path': '/dev/sdh'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233336133313363', 'path': '/dev/sdh'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.448s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG nova.objects.instance [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Lazy-loading 'flavor' on Instance uuid dcd1ca28-3784-45b3-a3d3-e3231d8e82bb {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09c233a-93bd-498a-b6ef-fabbca8edd0a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:09:50 user nova-compute[75293]: No targets found.
Nov 30 07:09:50 user nova-compute[75293]: iSNS:
Nov 30 07:09:50 user nova-compute[75293]: No targets found.
Nov 30 07:09:50 user nova-compute[75293]: STATIC:
Nov 30 07:09:50 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765
Nov 30 07:09:50 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:50 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:50 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685
Nov 30 07:09:50 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:50 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:50 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994
Nov 30 07:09:50 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:50 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:50 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6
Nov 30 07:09:50 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:50 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:50 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c
Nov 30 07:09:50 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:50 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:50 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89
Nov 30 07:09:50 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:50 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:50 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4
Nov 30 07:09:50 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:50 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:50 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50
Nov 30 07:09:50 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:50 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:50 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14
Nov 30 07:09:50 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:50 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:50 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51
Nov 30 07:09:50 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:50 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:50 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324
Nov 30 07:09:50 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:50 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:50 user nova-compute[75293]: FIRMWARE:
Nov 30 07:09:50 user nova-compute[75293]: No targets found.
Nov 30 07:09:50 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:09:50 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:09:50 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:09:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a10da0-0004-4d4b-82c7-f8eb16d60f05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.054s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d7fdcf-4300-4226-904e-abde2c55bf58]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:51 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe83c0f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6'): ({'sdj'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Removing single pathed devices sdj {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84c5e6e-1e18-4fb2-9d35-f67b244181f7]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba0d5ee-7342-454b-a5e4-48e29f0ed5c6]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Flushing IO for device /dev/sdj {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.056s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22f421b-bc1e-43e0-96fd-964ac24e9a38]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk --force-share --output=json" returned: 0 in 0.353s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.043s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b526506-2ae7-43bb-8f00-0d90f46c9d2b]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] SCSI volumes sdj have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a125804-4cdc-4657-a479-bfa282608e41]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdl (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.158s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cc87c4-d7bc-402a-9cbc-42eb7e24f607]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6, portal: 172.16.0.220,3260]
Nov 30 07:09:51 user nova-compute[75293]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6, portal: 172.16.0.220,3260] successful.
Nov 30 07:09:51 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80aa03ff-3ad8-434f-909e-580680bb32a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[531cbab6-f60a-409d-9f61-01f24227e2c9]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.618s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] <== disconnect_volume: return (1066ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] COPY block job progress, current cursor: 155189248 final cursor: 1073741824 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG nova.compute.manager [req-a1f853da-e630-41e0-8f59-445c5dd4438c req-7daee293-c7de-47e5-b850-50a3bdbb3322 service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Received event network-vif-deleted-53964f53-7286-4710-bc56-709f3d460ba2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:52 user nova-compute[75293]: INFO nova.compute.manager [req-a1f853da-e630-41e0-8f59-445c5dd4438c req-7daee293-c7de-47e5-b850-50a3bdbb3322 service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Neutron deleted interface 53964f53-7286-4710-bc56-709f3d460ba2; detaching it from the instance and deleting it from the info cache
Nov 30 07:09:52 user nova-compute[75293]: DEBUG nova.network.neutron [req-a1f853da-e630-41e0-8f59-445c5dd4438c req-7daee293-c7de-47e5-b850-50a3bdbb3322 service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:09:52 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Took 1.34 seconds to deallocate network for instance.
Nov 30 07:09:52 user nova-compute[75293]: DEBUG nova.compute.manager [req-a1f853da-e630-41e0-8f59-445c5dd4438c req-7daee293-c7de-47e5-b850-50a3bdbb3322 service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Detach interface failed, port_id=53964f53-7286-4710-bc56-709f3d460ba2, reason: Instance bb71c604-7f7e-4b71-8fa3-56bd77b649c3 could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG nova.compute.manager [req-fb7b5127-8a20-4b8f-9453-19931a517ad1 req-b092b3b7-e15d-4c29-a46c-4421d249e1ce service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Received event network-vif-plugged-53964f53-7286-4710-bc56-709f3d460ba2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fb7b5127-8a20-4b8f-9453-19931a517ad1 req-b092b3b7-e15d-4c29-a46c-4421d249e1ce service nova] Acquiring lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fb7b5127-8a20-4b8f-9453-19931a517ad1 req-b092b3b7-e15d-4c29-a46c-4421d249e1ce service nova] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fb7b5127-8a20-4b8f-9453-19931a517ad1 req-b092b3b7-e15d-4c29-a46c-4421d249e1ce service nova] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG nova.compute.manager [req-fb7b5127-8a20-4b8f-9453-19931a517ad1 req-b092b3b7-e15d-4c29-a46c-4421d249e1ce service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] No waiting events found dispatching network-vif-plugged-53964f53-7286-4710-bc56-709f3d460ba2 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:09:52 user nova-compute[75293]: WARNING nova.compute.manager [req-fb7b5127-8a20-4b8f-9453-19931a517ad1 req-b092b3b7-e15d-4c29-a46c-4421d249e1ce service nova] [instance: bb71c604-7f7e-4b71-8fa3-56bd77b649c3] Received unexpected event network-vif-plugged-53964f53-7286-4710-bc56-709f3d460ba2 for instance with vm_state deleted and task_state None.
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] COPY block job progress, current cursor: 309329920 final cursor: 1073741824 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:09:52 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 67b8a66b-e7f8-41a1-8f5c-b29851ec608d is timed out.
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.540s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG nova.objects.instance [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lazy-loading 'flavor' on Instance uuid 061832ab-930a-470b-8b4f-dfc8f19fea6b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:52 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Successfully detached device vdb from instance 67b8a66b-e7f8-41a1-8f5c-b29851ec608d from the live domain config.
Nov 30 07:09:52 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNkAxIqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:52 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fc470a-a32b-4fa1-846c-eacb5c61bc1b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:52 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Deleted allocations for instance bb71c604-7f7e-4b71-8fa3-56bd77b649c3
Nov 30 07:09:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:09:52 user nova-compute[75293]: No targets found.
Nov 30 07:09:52 user nova-compute[75293]: iSNS:
Nov 30 07:09:52 user nova-compute[75293]: No targets found.
Nov 30 07:09:52 user nova-compute[75293]: STATIC:
Nov 30 07:09:52 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765
Nov 30 07:09:52 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:52 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:52 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685
Nov 30 07:09:52 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:52 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:52 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994
Nov 30 07:09:52 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:52 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:52 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c
Nov 30 07:09:52 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:52 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:52 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89
Nov 30 07:09:52 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:52 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:52 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4
Nov 30 07:09:52 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:52 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:52 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50
Nov 30 07:09:52 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:52 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:52 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14
Nov 30 07:09:52 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:52 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:52 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51
Nov 30 07:09:52 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:52 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:52 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324
Nov 30 07:09:52 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:52 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:52 user nova-compute[75293]: FIRMWARE:
Nov 30 07:09:52 user nova-compute[75293]: No targets found.
Nov 30 07:09:52 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:09:52 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:09:52 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a66abfce-4525-4798-948b-c003632ea820 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.258s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace2b91b-f76b-4deb-8094-1dc29163ff47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[24020a5d-306f-4865-bab0-51e0dc677552]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:53 user nova-compute[75293]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:53 user nova-compute[75293]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)
Nov 30 07:09:53 user nova-compute[75293]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:53 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:53 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:53 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:53 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:53 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:53 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:53 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 (non-flash)
Nov 30 07:09:53 user nova-compute[75293]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:53 user nova-compute[75293]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)
Nov 30 07:09:53 user nova-compute[75293]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:53 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:53 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:53 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:53 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:53 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:53 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:53 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe82aa290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994'): ({'sdk'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Removing single pathed devices sdk {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c643f47-a422-4105-bc87-11f92376d51a tempest-AttachSCSIVolumeTestJSON-753889653 tempest-AttachSCSIVolumeTestJSON-753889653-project-member] Lock "bb71c604-7f7e-4b71-8fa3-56bd77b649c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.110s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43d25e0-559d-40b0-b8bf-8895db2acd15]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9426c5-cf8d-43ec-96c7-50aa06140a53]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Flushing IO for device /dev/sdk {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef63dc8-1c0a-42bb-9ef4-0964ae3db7d6]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.044s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c876c30-901a-496e-92ef-b410f9a7ce10]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] SCSI volumes sdk have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] COPY block job progress, current cursor: 443547648 final cursor: 1073741824 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d98c3c-85ab-4c69-90c8-8dcec5fe685f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --logout" returned: 0 in 0.120s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffeaa99-0b42-4079-a959-bc4b2a8b3773]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994, portal: 172.16.0.220,3260]
Nov 30 07:09:53 user nova-compute[75293]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994, portal: 172.16.0.220,3260] successful.
Nov 30 07:09:53 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4ccece-1180-4a11-a9bc-696af4e09994 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[174d8155-dd83-4ee8-bcf1-7b66b19975a0]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.526s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] <== disconnect_volume: return (528ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] COPY block job progress, current cursor: 596639744 final cursor: 1073741824 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] COPY block job progress, current cursor: 704643072 final cursor: 1073741824 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:09:54 user nova-compute[75293]: DEBUG nova.compute.manager [req-a6d94ba0-c570-4c5a-81b0-5e4a9fa3a31b req-f8cffc64-3a1e-42be-9f1d-2d3f1c0c6526 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-changed-5ef61853-620c-45df-9e8c-7ff595aecdf1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:54 user nova-compute[75293]: DEBUG nova.compute.manager [req-a6d94ba0-c570-4c5a-81b0-5e4a9fa3a31b req-f8cffc64-3a1e-42be-9f1d-2d3f1c0c6526 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Refreshing instance network info cache due to event network-changed-5ef61853-620c-45df-9e8c-7ff595aecdf1. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:09:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a6d94ba0-c570-4c5a-81b0-5e4a9fa3a31b req-f8cffc64-3a1e-42be-9f1d-2d3f1c0c6526 service nova] Acquiring lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:09:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a6d94ba0-c570-4c5a-81b0-5e4a9fa3a31b req-f8cffc64-3a1e-42be-9f1d-2d3f1c0c6526 service nova] Acquired lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:09:54 user nova-compute[75293]: DEBUG nova.network.neutron [req-a6d94ba0-c570-4c5a-81b0-5e4a9fa3a31b req-f8cffc64-3a1e-42be-9f1d-2d3f1c0c6526 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Refreshing network info cache for port 5ef61853-620c-45df-9e8c-7ff595aecdf1 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:09:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:09:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:09:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:09:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:09:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:09:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] COPY block job progress, current cursor: 976224256 final cursor: 1073741824 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:09:55 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:09:55 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=7278MB free_disk=25.366531372070312GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b6dee8d-d419-47a3-b2be-4d15e17d6061 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b7deb0a-39af-4d93-b93d-5765a731f702 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance dcd1ca28-3784-45b3-a3d3-e3231d8e82bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 061832ab-930a-470b-8b4f-dfc8f19fea6b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 67b8a66b-e7f8-41a1-8f5c-b29851ec608d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance ca1e65f3-8696-4c9a-b4df-ce5923e1de31 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 09b63cd9-2f63-411d-886d-3ff237d145d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance cc583d29-3df4-4406-b5a5-f4b3d300fabb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.network.neutron [req-a6d94ba0-c570-4c5a-81b0-5e4a9fa3a31b req-f8cffc64-3a1e-42be-9f1d-2d3f1c0c6526 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Updated VIF entry in instance network info cache for port 5ef61853-620c-45df-9e8c-7ff595aecdf1. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.network.neutron [req-a6d94ba0-c570-4c5a-81b0-5e4a9fa3a31b req-f8cffc64-3a1e-42be-9f1d-2d3f1c0c6526 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Updating instance_info_cache with network_info: [{"id": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "address": "fa:16:3e:03:dc:1e", "network": {"id": "d6d10985-38b5-4e72-9276-76a246a2275e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1743986748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef61853-62", "ovs_interfaceid": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "address": "fa:16:3e:5f:38:ec", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa8c23-b7", "ovs_interfaceid": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "address": "fa:16:3e:12:ac:0e", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d552b1b-e0", "ovs_interfaceid": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "address": "fa:16:3e:a2:e2:22", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ac9e07-c0", "ovs_interfaceid": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "address": "fa:16:3e:d6:3f:bd", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab42e005-7e", "ovs_interfaceid": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "address": "fa:16:3e:4b:ef:61", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa746d18c-57", "ovs_interfaceid": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "177273b3-02d1-4f5c-ae31-70103280dd88", "address": "fa:16:3e:d3:53:db", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177273b3-02", "ovs_interfaceid": "177273b3-02d1-4f5c-ae31-70103280dd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a6d94ba0-c570-4c5a-81b0-5e4a9fa3a31b req-f8cffc64-3a1e-42be-9f1d-2d3f1c0c6526 service nova] Releasing lock "refresh_cache-09b63cd9-2f63-411d-886d-3ff237d145d0" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kzHwhMjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '928456b8-83cb-449a-b7ec-630246aed685'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:55 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[60efed39-b2a5-4171-a1c2-be5fb14f8369]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:09:55 user nova-compute[75293]: No targets found.
Nov 30 07:09:55 user nova-compute[75293]: iSNS:
Nov 30 07:09:55 user nova-compute[75293]: No targets found.
Nov 30 07:09:55 user nova-compute[75293]: STATIC:
Nov 30 07:09:55 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765
Nov 30 07:09:55 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:55 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:55 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685
Nov 30 07:09:55 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:55 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:55 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c
Nov 30 07:09:55 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:55 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:55 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89
Nov 30 07:09:55 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:55 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:55 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4
Nov 30 07:09:55 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:55 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:55 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50
Nov 30 07:09:55 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:55 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:55 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14
Nov 30 07:09:55 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:55 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:55 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51
Nov 30 07:09:55 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:55 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:55 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324
Nov 30 07:09:55 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:55 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:55 user nova-compute[75293]: FIRMWARE:
Nov 30 07:09:55 user nova-compute[75293]: No targets found.
Nov 30 07:09:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:09:55 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:09:55 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bec9552-ed73-4600-97db-768722e445d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[49026a8b-36c0-4d1e-a876-51cc958a0b5f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:55 user nova-compute[75293]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)
Nov 30 07:09:55 user nova-compute[75293]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:55 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:55 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:55 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:55 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:55 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:55 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 (non-flash)
Nov 30 07:09:55 user nova-compute[75293]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)
Nov 30 07:09:55 user nova-compute[75293]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:55 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:55 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:55 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:55 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:55 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:55 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe82591b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685'): ({'sdl'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Removing single pathed devices sdl {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[38099695-aa07-4770-8f80-c9456b4b4bb3]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfce5f5-d8e5-463a-afee-bd288b7ad76a]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Flushing IO for device /dev/sdl {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf8a256-46ce-4f38-8b19-df42ae1828cf]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.031s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d933c8-ead9-4b38-983a-42e749b4c81b]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] SCSI volumes sdl have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[425cab3a-b2e1-4b7c-96c2-71516f40136f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f291cb39-ced2-48ed-bf22-1982c22caa3e]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685, portal: 172.16.0.220,3260]
Nov 30 07:09:55 user nova-compute[75293]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685, portal: 172.16.0.220,3260] successful.
Nov 30 07:09:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928456b8-83cb-449a-b7ec-630246aed685 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20abb1e-967e-422f-bfa5-a2f92c557e84]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] <== disconnect_volume: return (336ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZzqkOjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'dcd1ca28-3784-45b3-a3d3-e3231d8e82bb', 'attached_at': '', 'detached_at': '', 'volume_id': '3a07d874-8250-4118-823e-acc286caf324', 'serial'} {{(pid=75293) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] swap_volume: removing Cinder connection for volume 928456b8-83cb-449a-b7ec-630246aed685 {{(pid=75293) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG nova.objects.instance [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lazy-loading 'flavor' on Instance uuid 67b8a66b-e7f8-41a1-8f5c-b29851ec608d {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ac230b58-4a48-423c-8cee-22e1188f3a3e tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG nova.objects.instance [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lazy-loading 'flavor' on Instance uuid 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:56 user nova-compute[75293]: INFO nova.compute.manager [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Attaching volume 70c2fd19-a79e-4b40-8116-072dafa1a09d to /dev/vdb
Nov 30 07:09:56 user nova-compute[75293]: DEBUG os_brick.utils [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d758c6-686b-497b-a189-858a042a2581]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c2e240-69f7-4d6e-bc74-e9f4abcf02e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[945deb42-cef0-4fde-8264-32e3a79b03b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa4a2a2-65e6-4161-9b28-166d1e30ab54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:09:56 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7013fb37-1302-4642-bca7-794fcfc7e2a2]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG os_brick.utils [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Updating existing volume attachment record: 04006d54-1e92-43ec-91aa-b432cc3b19e3 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] swap_volume: Updating volume 928456b8-83cb-449a-b7ec-630246aed685 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "dZzqkOjK", "auth_password": "rZsOg0vj7pt5fl", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "3a07d874-8250-4118-823e-acc286caf324"}, "status": "reserved", "instance": "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb", "attached_at": "", "detached_at": "", "volume_id": "3a07d874-8250-4118-823e-acc286caf324", "serial": "3a07d874-8250-4118-823e-acc286caf324"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '3a07d874-8250-4118-823e-acc286caf324', 'no_device': None, 'attachment_id': 'd88af79d-293b-45c0-b4b5-cfae7c4b1767'} {{(pid=75293) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquiring lock "interface-67b8a66b-e7f8-41a1-8f5c-b29851ec608d-e9034327-6413-40df-842e-9ffbf58bb886" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "interface-67b8a66b-e7f8-41a1-8f5c-b29851ec608d-e9034327-6413-40df-842e-9ffbf58bb886" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f282ed8b-e3af-4aab-a764-12cdf28d21f6 tempest-TestVolumeSwap-933801258 tempest-TestVolumeSwap-933801258-project-admin] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.365s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:56 user nova-compute[75293]: INFO nova.compute.manager [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Terminating instance
Nov 30 07:09:56 user nova-compute[75293]: DEBUG nova.compute.manager [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG nova.objects.instance [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lazy-loading 'flavor' on Instance uuid 67b8a66b-e7f8-41a1-8f5c-b29851ec608d {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-448272992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-448272992',id=7,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjlAvbNSNxOu5edth1vYgsFbUXzkyrWPcRf1ffRD5CrTsh6WZzOo54MVbNVFLS5n8k7/BjeCIsOHkQu7rwF07QgVmeG30dScHl8rc2yZM/6i1oYAPea7ho5miPIPyzMag==',key_name='tempest-keypair-2066695250',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:07:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67436111c10f475a9e2d249fe77f04c9',ramdisk_id='',reservation_id='r-p1eo2eq9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-825521733',owner_user_name='tempest-TaggedAttachmentsTest-825521733-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:07:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3af22daef9746c99424bf6581cc7608',uuid=67b8a66b-e7f8-41a1-8f5c-b29851ec608d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9034327-6413-40df-842e-9ffbf58bb886", "address": "fa:16:3e:8c:13:37", "network": {"id": "b8c0f097-e9cb-4aa2-a925-da668439c435", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-656286509", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9034327-64", "ovs_interfaceid": "e9034327-6413-40df-842e-9ffbf58bb886", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Converting VIF {"id": "e9034327-6413-40df-842e-9ffbf58bb886", "address": "fa:16:3e:8c:13:37", "network": {"id": "b8c0f097-e9cb-4aa2-a925-da668439c435", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-656286509", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9034327-64", "ovs_interfaceid": "e9034327-6413-40df-842e-9ffbf58bb886", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:13:37,bridge_name='br-int',has_traffic_filtering=True,id=e9034327-6413-40df-842e-9ffbf58bb886,network=Network(b8c0f097-e9cb-4aa2-a925-da668439c435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9034327-64') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8c:13:37"/><model type="virtio"/><mtu size="1442"/><target dev="tape9034327-64"/></interface> {{(pid=75293) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8c:13:37"/><model type="virtio"/><mtu size="1442"/><target dev="tape9034327-64"/></interface> {{(pid=75293) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Attempting to detach device tape9034327-64 from instance 67b8a66b-e7f8-41a1-8f5c-b29851ec608d from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] detach device xml: <interface type="ethernet">
Nov 30 07:09:56 user nova-compute[75293]:   <mac address="fa:16:3e:8c:13:37"/>
Nov 30 07:09:56 user nova-compute[75293]:   <model type="virtio"/>
Nov 30 07:09:56 user nova-compute[75293]:   <mtu size="1442"/>
Nov 30 07:09:56 user nova-compute[75293]:   <target dev="tape9034327-64"/>
Nov 30 07:09:56 user nova-compute[75293]: </interface>
Nov 30 07:09:56 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8c:13:37"/><model type="virtio"/><mtu size="1442"/><target dev="tape9034327-64"/></interface> {{(pid=75293) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 07:09:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8c:13:37"/><model type="virtio"/><mtu size="1442"/><target dev="tape9034327-64"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 30 07:09:56 user nova-compute[75293]:   <name>instance-00000007</name>
Nov 30 07:09:56 user nova-compute[75293]:   <uuid>67b8a66b-e7f8-41a1-8f5c-b29851ec608d</uuid>
Nov 30 07:09:56 user nova-compute[75293]:   <metadata>
Nov 30 07:09:56 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:09:56 user nova-compute[75293]:   <nova:package version="0.0.0"/>
Nov 30 07:09:56 user nova-compute[75293]:   <nova:name>tempest-device-tagging-server-448272992</nova:name>
Nov 30 07:09:56 user nova-compute[75293]:   <nova:creationTime>2023-11-30 07:09:18</nova:creationTime>
Nov 30 07:09:56 user nova-compute[75293]:   <nova:flavor name="m1.tiny">
Nov 30 07:09:56 user nova-compute[75293]:     <nova:memory>512</nova:memory>
Nov 30 07:09:56 user nova-compute[75293]:     <nova:disk>1</nova:disk>
Nov 30 07:09:56 user nova-compute[75293]:     <nova:swap>0</nova:swap>
Nov 30 07:09:56 user nova-compute[75293]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:09:56 user nova-compute[75293]:     <nova:vcpus>1</nova:vcpus>
Nov 30 07:09:56 user nova-compute[75293]:   </nova:flavor>
Nov 30 07:09:56 user nova-compute[75293]:   <nova:owner>
Nov 30 07:09:56 user nova-compute[75293]:     <nova:user uuid="d3af22daef9746c99424bf6581cc7608">tempest-TaggedAttachmentsTest-825521733-project-member</nova:user>
Nov 30 07:09:56 user nova-compute[75293]:     <nova:project uuid="67436111c10f475a9e2d249fe77f04c9">tempest-TaggedAttachmentsTest-825521733</nova:project>
Nov 30 07:09:56 user nova-compute[75293]:   </nova:owner>
Nov 30 07:09:56 user nova-compute[75293]:   <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:09:56 user nova-compute[75293]:   <nova:ports>
Nov 30 07:09:56 user nova-compute[75293]:     <nova:port uuid="4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e">
Nov 30 07:09:56 user nova-compute[75293]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 07:09:56 user nova-compute[75293]:     </nova:port>
Nov 30 07:09:56 user nova-compute[75293]:     <nova:port uuid="e9034327-6413-40df-842e-9ffbf58bb886">
Nov 30 07:09:56 user nova-compute[75293]:       <nova:ip type="fixed" address="10.10.10.52" ipVersion="4"/>
Nov 30 07:09:56 user nova-compute[75293]:     </nova:port>
Nov 30 07:09:56 user nova-compute[75293]:   </nova:ports>
Nov 30 07:09:56 user nova-compute[75293]: </nova:instance>
Nov 30 07:09:56 user nova-compute[75293]:   </metadata>
Nov 30 07:09:56 user nova-compute[75293]:   <memory unit='KiB'>524288</memory>
Nov 30 07:09:56 user nova-compute[75293]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 30 07:09:56 user nova-compute[75293]:   <vcpu placement='static'>1</vcpu>
Nov 30 07:09:56 user nova-compute[75293]:   <resource>
Nov 30 07:09:56 user nova-compute[75293]:     <partition>/machine</partition>
Nov 30 07:09:56 user nova-compute[75293]:   </resource>
Nov 30 07:09:56 user nova-compute[75293]:   <sysinfo type='smbios'>
Nov 30 07:09:56 user nova-compute[75293]:     <system>
Nov 30 07:09:56 user nova-compute[75293]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 30 07:09:56 user nova-compute[75293]:       <entry name='product'>OpenStack Nova</entry>
Nov 30 07:09:56 user nova-compute[75293]:       <entry name='version'>0.0.0</entry>
Nov 30 07:09:56 user nova-compute[75293]:       <entry name='serial'>67b8a66b-e7f8-41a1-8f5c-b29851ec608d</entry>
Nov 30 07:09:56 user nova-compute[75293]:       <entry name='uuid'>67b8a66b-e7f8-41a1-8f5c-b29851ec608d</entry>
Nov 30 07:09:56 user nova-compute[75293]:       <entry name='family'>Virtual Machine</entry>
Nov 30 07:09:56 user nova-compute[75293]:     </system>
Nov 30 07:09:56 user nova-compute[75293]:   </sysinfo>
Nov 30 07:09:56 user nova-compute[75293]:   <os>
Nov 30 07:09:56 user nova-compute[75293]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 30 07:09:56 user nova-compute[75293]:     <boot dev='hd'/>
Nov 30 07:09:56 user nova-compute[75293]:     <smbios mode='sysinfo'/>
Nov 30 07:09:56 user nova-compute[75293]:   </os>
Nov 30 07:09:56 user nova-compute[75293]:   <features>
Nov 30 07:09:56 user nova-compute[75293]:     <acpi/>
Nov 30 07:09:56 user nova-compute[75293]:     <apic/>
Nov 30 07:09:56 user nova-compute[75293]:     <vmcoreinfo state='on'/>
Nov 30 07:09:56 user nova-compute[75293]:   </features>
Nov 30 07:09:56 user nova-compute[75293]:   <cpu mode='custom' match='exact' check='full'>
Nov 30 07:09:56 user nova-compute[75293]:     <model fallback='forbid'>Nehalem</model>
Nov 30 07:09:56 user nova-compute[75293]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 30 07:09:56 user nova-compute[75293]:     <feature policy='require' name='vme'/>
Nov 30 07:09:56 user nova-compute[75293]:     <feature policy='require' name='x2apic'/>
Nov 30 07:09:56 user nova-compute[75293]:     <feature policy='require' name='hypervisor'/>
Nov 30 07:09:56 user nova-compute[75293]:   </cpu>
Nov 30 07:09:56 user nova-compute[75293]:   <clock offset='utc'>
Nov 30 07:09:56 user nova-compute[75293]:     <timer name='pit' tickpolicy='delay'/>
Nov 30 07:09:56 user nova-compute[75293]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 30 07:09:56 user nova-compute[75293]:     <timer name='hpet' present='no'/>
Nov 30 07:09:56 user nova-compute[75293]:   </clock>
Nov 30 07:09:56 user nova-compute[75293]:   <on_poweroff>destroy</on_poweroff>
Nov 30 07:09:56 user nova-compute[75293]:   <on_reboot>restart</on_reboot>
Nov 30 07:09:56 user nova-compute[75293]:   <on_crash>destroy</on_crash>
Nov 30 07:09:56 user nova-compute[75293]:   <devices>
Nov 30 07:09:56 user nova-compute[75293]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 07:09:56 user nova-compute[75293]:     <disk type='file' device='disk'>
Nov 30 07:09:56 user nova-compute[75293]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 30 07:09:56 user nova-compute[75293]:       <source file='/opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk' index='2'/>
Nov 30 07:09:56 user nova-compute[75293]:       <backingStore type='file' index='3'>
Nov 30 07:09:56 user nova-compute[75293]:         <format type='raw'/>
Nov 30 07:09:56 user nova-compute[75293]:         <source file='/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1'/>
Nov 30 07:09:56 user nova-compute[75293]:         <backingStore/>
Nov 30 07:09:56 user nova-compute[75293]:       </backingStore>
Nov 30 07:09:56 user nova-compute[75293]:       <target dev='vda' bus='virtio'/>
Nov 30 07:09:56 user nova-compute[75293]:       <alias name='virtio-disk0'/>
Nov 30 07:09:56 user nova-compute[75293]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 30 07:09:56 user nova-compute[75293]:     </disk>
Nov 30 07:09:56 user nova-compute[75293]:     <disk type='file' device='cdrom'>
Nov 30 07:09:56 user nova-compute[75293]:       <driver name='qemu' type='raw' cache='none'/>
Nov 30 07:09:56 user nova-compute[75293]:       <source file='/opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk.config' index='1'/>
Nov 30 07:09:56 user nova-compute[75293]:       <backingStore/>
Nov 30 07:09:56 user nova-compute[75293]:       <target dev='hda' bus='ide'/>
Nov 30 07:09:56 user nova-compute[75293]:       <readonly/>
Nov 30 07:09:56 user nova-compute[75293]:       <alias name='ide0-0-0'/>
Nov 30 07:09:56 user nova-compute[75293]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 30 07:09:56 user nova-compute[75293]:     </disk>
Nov 30 07:09:56 user nova-compute[75293]:     <controller type='usb' index='0' model='none'>
Nov 30 07:09:56 user nova-compute[75293]:       <alias name='usb'/>
Nov 30 07:09:56 user nova-compute[75293]:     </controller>
Nov 30 07:09:56 user nova-compute[75293]:     <controller type='pci' index='0' model='pci-root'>
Nov 30 07:09:56 user nova-compute[75293]:       <alias name='pci.0'/>
Nov 30 07:09:56 user nova-compute[75293]:     </controller>
Nov 30 07:09:56 user nova-compute[75293]:     <controller type='ide' index='0'>
Nov 30 07:09:56 user nova-compute[75293]:       <alias name='ide'/>
Nov 30 07:09:56 user nova-compute[75293]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 30 07:09:56 user nova-compute[75293]:     </controller>
Nov 30 07:09:56 user nova-compute[75293]:     <interface type='ethernet'>
Nov 30 07:09:56 user nova-compute[75293]:       <mac address='fa:16:3e:2b:05:2c'/>
Nov 30 07:09:56 user nova-compute[75293]:       <target dev='tap4079c1bd-9b'/>
Nov 30 07:09:56 user nova-compute[75293]:       <model type='virtio'/>
Nov 30 07:09:56 user nova-compute[75293]:       <mtu size='1442'/>
Nov 30 07:09:56 user nova-compute[75293]:       <alias name='net0'/>
Nov 30 07:09:56 user nova-compute[75293]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 30 07:09:56 user nova-compute[75293]:     </interface>
Nov 30 07:09:56 user nova-compute[75293]:     <interface type='ethernet'>
Nov 30 07:09:56 user nova-compute[75293]:       <mac address='fa:16:3e:8c:13:37'/>
Nov 30 07:09:56 user nova-compute[75293]:       <target dev='tape9034327-64'/>
Nov 30 07:09:56 user nova-compute[75293]:       <model type='virtio'/>
Nov 30 07:09:56 user nova-compute[75293]:       <mtu size='1442'/>
Nov 30 07:09:56 user nova-compute[75293]:       <alias name='net1'/>
Nov 30 07:09:56 user nova-compute[75293]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 30 07:09:56 user nova-compute[75293]:     </interface>
Nov 30 07:09:56 user nova-compute[75293]:     <serial type='pty'>
Nov 30 07:09:56 user nova-compute[75293]:       <source path='/dev/pts/6'/>
Nov 30 07:09:56 user nova-compute[75293]:       <log file='/opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/console.log' append='off'/>
Nov 30 07:09:56 user nova-compute[75293]:       <target type='isa-serial' port='0'>
Nov 30 07:09:56 user nova-compute[75293]:         <model name='isa-serial'/>
Nov 30 07:09:56 user nova-compute[75293]:       </target>
Nov 30 07:09:56 user nova-compute[75293]:       <alias name='serial0'/>
Nov 30 07:09:56 user nova-compute[75293]:     </serial>
Nov 30 07:09:56 user nova-compute[75293]:     <console type='pty' tty='/dev/pts/6'>
Nov 30 07:09:56 user nova-compute[75293]:       <source path='/dev/pts/6'/>
Nov 30 07:09:56 user nova-compute[75293]:       <log file='/opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/console.log' append='off'/>
Nov 30 07:09:56 user nova-compute[75293]:       <target type='serial' port='0'/>
Nov 30 07:09:56 user nova-compute[75293]:       <alias name='serial0'/>
Nov 30 07:09:56 user nova-compute[75293]:     </console>
Nov 30 07:09:56 user nova-compute[75293]:     <input type='mouse' bus='ps2'>
Nov 30 07:09:56 user nova-compute[75293]:       <alias name='input0'/>
Nov 30 07:09:56 user nova-compute[75293]:     </input>
Nov 30 07:09:56 user nova-compute[75293]:     <input type='keyboard' bus='ps2'>
Nov 30 07:09:56 user nova-compute[75293]:       <alias name='input1'/>
Nov 30 07:09:56 user nova-compute[75293]:     </input>
Nov 30 07:09:56 user nova-compute[75293]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 30 07:09:56 user nova-compute[75293]:       <listen type='address' address='0.0.0.0'/>
Nov 30 07:09:56 user nova-compute[75293]:     </graphics>
Nov 30 07:09:56 user nova-compute[75293]:     <audio id='1' type='none'/>
Nov 30 07:09:56 user nova-compute[75293]:     <video>
Nov 30 07:09:56 user nova-compute[75293]:       <model type='virtio' heads='1' primary='yes'/>
Nov 30 07:09:56 user nova-compute[75293]:       <alias name='video0'/>
Nov 30 07:09:56 user nova-compute[75293]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 30 07:09:56 user nova-compute[75293]:     </video>
Nov 30 07:09:56 user nova-compute[75293]:     <memballoon model='virtio'>
Nov 30 07:09:56 user nova-compute[75293]:       <stats period='10'/>
Nov 30 07:09:56 user nova-compute[75293]:       <alias name='balloon0'/>
Nov 30 07:09:56 user nova-compute[75293]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 30 07:09:56 user nova-compute[75293]:     </memballoon>
Nov 30 07:09:56 user nova-compute[75293]:     <rng model='virtio'>
Nov 30 07:09:56 user nova-compute[75293]:       <backend model='random'>/dev/urandom</backend>
Nov 30 07:09:56 user nova-compute[75293]:       <alias name='rng0'/>
Nov 30 07:09:56 user nova-compute[75293]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 30 07:09:56 user nova-compute[75293]:     </rng>
Nov 30 07:09:56 user nova-compute[75293]:   </devices>
Nov 30 07:09:56 user nova-compute[75293]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 30 07:09:56 user nova-compute[75293]:     <label>libvirt-67b8a66b-e7f8-41a1-8f5c-b29851ec608d</label>
Nov 30 07:09:56 user nova-compute[75293]:     <imagelabel>libvirt-67b8a66b-e7f8-41a1-8f5c-b29851ec608d</imagelabel>
Nov 30 07:09:56 user nova-compute[75293]:   </seclabel>
Nov 30 07:09:56 user nova-compute[75293]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 30 07:09:56 user nova-compute[75293]:     <label>+64055:+108</label>
Nov 30 07:09:56 user nova-compute[75293]:     <imagelabel>+64055:+108</imagelabel>
Nov 30 07:09:56 user nova-compute[75293]:   </seclabel>
Nov 30 07:09:56 user nova-compute[75293]: </domain>
Nov 30 07:09:56 user nova-compute[75293]:  {{(pid=75293) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 30 07:09:57 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Successfully detached device tape9034327-64 from instance 67b8a66b-e7f8-41a1-8f5c-b29851ec608d from the persistent domain config.
Nov 30 07:09:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] (1/8): Attempting to detach device tape9034327-64 with device alias net1 from instance 67b8a66b-e7f8-41a1-8f5c-b29851ec608d from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] detach device xml: <interface type="ethernet">
Nov 30 07:09:57 user nova-compute[75293]:   <mac address="fa:16:3e:8c:13:37"/>
Nov 30 07:09:57 user nova-compute[75293]:   <model type="virtio"/>
Nov 30 07:09:57 user nova-compute[75293]:   <mtu size="1442"/>
Nov 30 07:09:57 user nova-compute[75293]:   <target dev="tape9034327-64"/>
Nov 30 07:09:57 user nova-compute[75293]: </interface>
Nov 30 07:09:57 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG nova.compute.manager [req-9b21dfd0-d187-4c93-815a-9acbdea16965 req-4a574601-0f24-4124-8e7c-1e5678009abc service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-unplugged-5ef61853-620c-45df-9e8c-7ff595aecdf1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9b21dfd0-d187-4c93-815a-9acbdea16965 req-4a574601-0f24-4124-8e7c-1e5678009abc service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9b21dfd0-d187-4c93-815a-9acbdea16965 req-4a574601-0f24-4124-8e7c-1e5678009abc service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9b21dfd0-d187-4c93-815a-9acbdea16965 req-4a574601-0f24-4124-8e7c-1e5678009abc service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG nova.compute.manager [req-9b21dfd0-d187-4c93-815a-9acbdea16965 req-4a574601-0f24-4124-8e7c-1e5678009abc service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-unplugged-5ef61853-620c-45df-9e8c-7ff595aecdf1 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG nova.compute.manager [req-9b21dfd0-d187-4c93-815a-9acbdea16965 req-4a574601-0f24-4124-8e7c-1e5678009abc service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-unplugged-5ef61853-620c-45df-9e8c-7ff595aecdf1 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Start waiting for the detach event from libvirt for device tape9034327-64 with device alias net1 for instance 67b8a66b-e7f8-41a1-8f5c-b29851ec608d {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG nova.compute.manager [req-80aa74e7-749b-4ca3-a900-eb259fbd76dc req-a8775765-764d-444b-8fa2-b2a0bb906b04 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received event network-vif-unplugged-e9034327-6413-40df-842e-9ffbf58bb886 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-80aa74e7-749b-4ca3-a900-eb259fbd76dc req-a8775765-764d-444b-8fa2-b2a0bb906b04 service nova] Acquiring lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-80aa74e7-749b-4ca3-a900-eb259fbd76dc req-a8775765-764d-444b-8fa2-b2a0bb906b04 service nova] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-80aa74e7-749b-4ca3-a900-eb259fbd76dc req-a8775765-764d-444b-8fa2-b2a0bb906b04 service nova] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG nova.compute.manager [req-80aa74e7-749b-4ca3-a900-eb259fbd76dc req-a8775765-764d-444b-8fa2-b2a0bb906b04 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] No waiting events found dispatching network-vif-unplugged-e9034327-6413-40df-842e-9ffbf58bb886 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:09:57 user nova-compute[75293]: WARNING nova.compute.manager [req-80aa74e7-749b-4ca3-a900-eb259fbd76dc req-a8775765-764d-444b-8fa2-b2a0bb906b04 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received unexpected event network-vif-unplugged-e9034327-6413-40df-842e-9ffbf58bb886 for instance with vm_state active and task_state None.
Nov 30 07:09:57 user nova-compute[75293]: DEBUG nova.compute.manager [req-261123db-0281-4725-8241-710c218a507b req-08e1a338-37a0-4c59-9c5a-531aa5807f85 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-unplugged-e8aa8c23-b7b1-4fed-80e2-ab511875b253 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-261123db-0281-4725-8241-710c218a507b req-08e1a338-37a0-4c59-9c5a-531aa5807f85 service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-261123db-0281-4725-8241-710c218a507b req-08e1a338-37a0-4c59-9c5a-531aa5807f85 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-261123db-0281-4725-8241-710c218a507b req-08e1a338-37a0-4c59-9c5a-531aa5807f85 service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG nova.compute.manager [req-261123db-0281-4725-8241-710c218a507b req-08e1a338-37a0-4c59-9c5a-531aa5807f85 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-unplugged-e8aa8c23-b7b1-4fed-80e2-ab511875b253 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG nova.compute.manager [req-261123db-0281-4725-8241-710c218a507b req-08e1a338-37a0-4c59-9c5a-531aa5807f85 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-unplugged-e8aa8c23-b7b1-4fed-80e2-ab511875b253 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Acquiring lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:58 user nova-compute[75293]: INFO nova.compute.manager [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Detaching volume 3a07d874-8250-4118-823e-acc286caf324
Nov 30 07:09:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:58 user nova-compute[75293]: INFO nova.virt.block_device [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Attempting to driver detach volume 3a07d874-8250-4118-823e-acc286caf324 from mountpoint /dev/vdb
Nov 30 07:09:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Attempting to detach device vdb from instance dcd1ca28-3784-45b3-a3d3-e3231d8e82bb from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:09:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:09:58 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:09:58 user nova-compute[75293]:   <source dev="/dev/sdh"/>
Nov 30 07:09:58 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:09:58 user nova-compute[75293]:   <serial>3a07d874-8250-4118-823e-acc286caf324</serial>
Nov 30 07:09:58 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:09:58 user nova-compute[75293]: </disk>
Nov 30 07:09:58 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:09:58 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Successfully detached device vdb from instance dcd1ca28-3784-45b3-a3d3-e3231d8e82bb from the persistent domain config.
Nov 30 07:09:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dcd1ca28-3784-45b3-a3d3-e3231d8e82bb from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:09:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:09:58 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:09:58 user nova-compute[75293]:   <source dev="/dev/sdh"/>
Nov 30 07:09:58 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:09:58 user nova-compute[75293]:   <serial>3a07d874-8250-4118-823e-acc286caf324</serial>
Nov 30 07:09:58 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:09:58 user nova-compute[75293]: </disk>
Nov 30 07:09:58 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:09:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dcd1ca28-3784-45b3-a3d3-e3231d8e82bb {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:09:59 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Instance destroyed successfully.
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.objects.instance [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lazy-loading 'resources' on Instance uuid 09b63cd9-2f63-411d-886d-3ff237d145d0 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:08:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:08:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "address": "fa:16:3e:03:dc:1e", "network": {"id": "d6d10985-38b5-4e72-9276-76a246a2275e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1743986748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef61853-62", "ovs_interfaceid": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "address": "fa:16:3e:03:dc:1e", "network": {"id": "d6d10985-38b5-4e72-9276-76a246a2275e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1743986748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef61853-62", "ovs_interfaceid": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:dc:1e,bridge_name='br-int',has_traffic_filtering=True,id=5ef61853-620c-45df-9e8c-7ff595aecdf1,network=Network(d6d10985-38b5-4e72-9276-76a246a2275e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef61853-62') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:dc:1e,bridge_name='br-int',has_traffic_filtering=True,id=5ef61853-620c-45df-9e8c-7ff595aecdf1,network=Network(d6d10985-38b5-4e72-9276-76a246a2275e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef61853-62') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ef61853-62, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd1760d4-673d-4b69-9917-8eb26f78c920) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: INFO os_vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:dc:1e,bridge_name='br-int',has_traffic_filtering=True,id=5ef61853-620c-45df-9e8c-7ff595aecdf1,network=Network(d6d10985-38b5-4e72-9276-76a246a2275e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ef61853-62')
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:08:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:08:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "address": "fa:16:3e:5f:38:ec", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa8c23-b7", "ovs_interfaceid": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "address": "fa:16:3e:5f:38:ec", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa8c23-b7", "ovs_interfaceid": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:38:ec,bridge_name='br-int',has_traffic_filtering=True,id=e8aa8c23-b7b1-4fed-80e2-ab511875b253,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape8aa8c23-b7') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:38:ec,bridge_name='br-int',has_traffic_filtering=True,id=e8aa8c23-b7b1-4fed-80e2-ab511875b253,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape8aa8c23-b7') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8aa8c23-b7, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:59 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ca1e65f3-8696-4c9a-b4df-ce5923e1de31 is timed out.
Nov 30 07:09:59 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Successfully detached device vdb from instance ca1e65f3-8696-4c9a-b4df-ce5923e1de31 from the live domain config.
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VsmaQekr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:59 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea79b8e9-f936-44ad-bf5a-8100df67e8de) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6926a08a-e149-4b7e-8256-5466ff810367]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:09:59 user nova-compute[75293]: No targets found.
Nov 30 07:09:59 user nova-compute[75293]: iSNS:
Nov 30 07:09:59 user nova-compute[75293]: No targets found.
Nov 30 07:09:59 user nova-compute[75293]: STATIC:
Nov 30 07:09:59 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765
Nov 30 07:09:59 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:59 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:59 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c
Nov 30 07:09:59 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:59 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:59 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89
Nov 30 07:09:59 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:59 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:59 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4
Nov 30 07:09:59 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:59 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:59 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50
Nov 30 07:09:59 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:59 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:59 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14
Nov 30 07:09:59 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:59 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:59 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51
Nov 30 07:09:59 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:59 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:59 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324
Nov 30 07:09:59 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:59 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:59 user nova-compute[75293]: FIRMWARE:
Nov 30 07:09:59 user nova-compute[75293]: No targets found.
Nov 30 07:09:59 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:09:59 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:09:59 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[968a2562-a936-4b4f-ba3f-e584600a9d09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: INFO os_vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:38:ec,bridge_name='br-int',has_traffic_filtering=True,id=e8aa8c23-b7b1-4fed-80e2-ab511875b253,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape8aa8c23-b7')
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:08:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:08:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "address": "fa:16:3e:12:ac:0e", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d552b1b-e0", "ovs_interfaceid": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "address": "fa:16:3e:12:ac:0e", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d552b1b-e0", "ovs_interfaceid": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:ac:0e,bridge_name='br-int',has_traffic_filtering=True,id=3d552b1b-e03f-49a7-9f26-50748172b6d0,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d552b1b-e0') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:ac:0e,bridge_name='br-int',has_traffic_filtering=True,id=3d552b1b-e03f-49a7-9f26-50748172b6d0,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d552b1b-e0') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d552b1b-e0, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c234807-6d14-4633-a21f-79b21f1a4339]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe804e9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4'): ({'sdm'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Removing single pathed devices sdm {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-5280b725-5332-411f-98a2-3b191d8b4520 req-fbf814cf-940c-4c83-80b6-d60ff8e6478a service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-5ef61853-620c-45df-9e8c-7ff595aecdf1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5280b725-5332-411f-98a2-3b191d8b4520 req-fbf814cf-940c-4c83-80b6-d60ff8e6478a service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5280b725-5332-411f-98a2-3b191d8b4520 req-fbf814cf-940c-4c83-80b6-d60ff8e6478a service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5280b725-5332-411f-98a2-3b191d8b4520 req-fbf814cf-940c-4c83-80b6-d60ff8e6478a service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-5280b725-5332-411f-98a2-3b191d8b4520 req-fbf814cf-940c-4c83-80b6-d60ff8e6478a service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-5ef61853-620c-45df-9e8c-7ff595aecdf1 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:09:59 user nova-compute[75293]: WARNING nova.compute.manager [req-5280b725-5332-411f-98a2-3b191d8b4520 req-fbf814cf-940c-4c83-80b6-d60ff8e6478a service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-5ef61853-620c-45df-9e8c-7ff595aecdf1 for instance with vm_state active and task_state deleting.
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31d0ff5-0e18-4498-b873-1ac1c6aaa4cb]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd4e7e9a-d72f-43c7-8983-8fd637d247fe) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[42eef334-4844-4e75-8c80-2e38438a282c]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Flushing IO for device /dev/sdm {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a727ae-34be-4377-a879-b66d4e5ff99c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: INFO os_vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:ac:0e,bridge_name='br-int',has_traffic_filtering=True,id=3d552b1b-e03f-49a7-9f26-50748172b6d0,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d552b1b-e0')
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:08:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:08:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "address": "fa:16:3e:a2:e2:22", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ac9e07-c0", "ovs_interfaceid": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "address": "fa:16:3e:a2:e2:22", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ac9e07-c0", "ovs_interfaceid": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e2:22,bridge_name='br-int',has_traffic_filtering=True,id=b9ac9e07-c027-4b26-ab1f-fe548b6a74a9,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ac9e07-c0') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e2:22,bridge_name='br-int',has_traffic_filtering=True,id=b9ac9e07-c027-4b26-ab1f-fe548b6a74a9,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ac9e07-c0') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9ac9e07-c0, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.035s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[431a43be-4425-4ae9-a041-1bd3340fc85d]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Checking to see if SCSI volumes sdm have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] SCSI volumes sdm have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[967a3c8f-7a0e-412a-a5d7-ca744bd63b52]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d473c80-f271-40ee-b102-f19de0236b51) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: INFO os_vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e2:22,bridge_name='br-int',has_traffic_filtering=True,id=b9ac9e07-c027-4b26-ab1f-fe548b6a74a9,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ac9e07-c0')
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:08:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:08:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "address": "fa:16:3e:d6:3f:bd", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab42e005-7e", "ovs_interfaceid": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "address": "fa:16:3e:d6:3f:bd", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab42e005-7e", "ovs_interfaceid": "ab42e005-7e8c-4b45-a30b-c4f1c743b3a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:3f:bd,bridge_name='br-int',has_traffic_filtering=True,id=ab42e005-7e8c-4b45-a30b-c4f1c743b3a4,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab42e005-7e') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:3f:bd,bridge_name='br-int',has_traffic_filtering=True,id=ab42e005-7e8c-4b45-a30b-c4f1c743b3a4,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab42e005-7e') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab42e005-7e, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c302ed45-3d01-4e17-a918-8b13a0861217) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[885567ab-803b-4f0b-adcf-31f5bd6a023e]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4, portal: 172.16.0.220,3260]
Nov 30 07:09:59 user nova-compute[75293]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4, portal: 172.16.0.220,3260] successful.
Nov 30 07:09:59 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: INFO os_vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:3f:bd,bridge_name='br-int',has_traffic_filtering=True,id=ab42e005-7e8c-4b45-a30b-c4f1c743b3a4,network=Network(3d697058-892a-4743-99b8-4e02fc775577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab42e005-7e')
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:08:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:08:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "address": "fa:16:3e:4b:ef:61", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa746d18c-57", "ovs_interfaceid": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "address": "fa:16:3e:4b:ef:61", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa746d18c-57", "ovs_interfaceid": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ef:61,bridge_name='br-int',has_traffic_filtering=True,id=a746d18c-574c-4c72-b3af-c5d7d6387f9c,network=Network(3c6d9467-49b6-456e-ac11-0c7286c2b773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa746d18c-57') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ef:61,bridge_name='br-int',has_traffic_filtering=True,id=a746d18c-574c-4c72-b3af-c5d7d6387f9c,network=Network(3c6d9467-49b6-456e-ac11-0c7286c2b773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa746d18c-57') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa746d18c-57, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e81a92be-a530-480e-ae80-cff4f154e9f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cae688-3866-473d-a3f7-254136b26c14]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] <== disconnect_volume: return (378ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0bd4378-84a0-4ef4-9d9a-0cf0e837b57f) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: INFO os_vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ef:61,bridge_name='br-int',has_traffic_filtering=True,id=a746d18c-574c-4c72-b3af-c5d7d6387f9c,network=Network(3c6d9467-49b6-456e-ac11-0c7286c2b773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa746d18c-57')
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-174159183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-174159183',id=11,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaa2mqWUNM8HtYn6LPbkQjTWZkScQ4yGx7FcfJIlv5uoXWZls8aBtOsWGpgdkYM1L2ZQPQwzmxGotpjiQID4NYYKHa9BP881Or6q9rhAzZBoa03iiEKh0NjdKOX3eDWXg==',key_name='tempest-keypair-1142958606',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:08:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f62b7927ac1e441ca0897d81a5bb527e',ramdisk_id='',reservation_id='r-pb1mtyhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1519881645',owner_user_name='tempest-TaggedBootDevicesTest-1519881645-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:08:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413a648e1b45497d9663faef32ad1a13',uuid=09b63cd9-2f63-411d-886d-3ff237d145d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "177273b3-02d1-4f5c-ae31-70103280dd88", "address": "fa:16:3e:d3:53:db", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177273b3-02", "ovs_interfaceid": "177273b3-02d1-4f5c-ae31-70103280dd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converting VIF {"id": "177273b3-02d1-4f5c-ae31-70103280dd88", "address": "fa:16:3e:d3:53:db", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177273b3-02", "ovs_interfaceid": "177273b3-02d1-4f5c-ae31-70103280dd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:53:db,bridge_name='br-int',has_traffic_filtering=True,id=177273b3-02d1-4f5c-ae31-70103280dd88,network=Network(3c6d9467-49b6-456e-ac11-0c7286c2b773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap177273b3-02') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:53:db,bridge_name='br-int',has_traffic_filtering=True,id=177273b3-02d1-4f5c-ae31-70103280dd88,network=Network(3c6d9467-49b6-456e-ac11-0c7286c2b773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap177273b3-02') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap177273b3-02, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d8d9329-65c5-4819-ab92-19eff1606b6b) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:09:59 user nova-compute[75293]: INFO os_vif [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:53:db,bridge_name='br-int',has_traffic_filtering=True,id=177273b3-02d1-4f5c-ae31-70103280dd88,network=Network(3c6d9467-49b6-456e-ac11-0c7286c2b773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap177273b3-02')
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMedBsOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:09:59 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received event network-vif-plugged-e9034327-6413-40df-842e-9ffbf58bb886 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] Acquiring lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] No waiting events found dispatching network-vif-plugged-e9034327-6413-40df-842e-9ffbf58bb886 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:09:59 user nova-compute[75293]: WARNING nova.compute.manager [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received unexpected event network-vif-plugged-e9034327-6413-40df-842e-9ffbf58bb886 for instance with vm_state active and task_state None.
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-unplugged-b9ac9e07-c027-4b26-ab1f-fe548b6a74a9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-unplugged-b9ac9e07-c027-4b26-ab1f-fe548b6a74a9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-unplugged-b9ac9e07-c027-4b26-ab1f-fe548b6a74a9 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-b9ac9e07-c027-4b26-ab1f-fe548b6a74a9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-b9ac9e07-c027-4b26-ab1f-fe548b6a74a9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:09:59 user nova-compute[75293]: WARNING nova.compute.manager [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-b9ac9e07-c027-4b26-ab1f-fe548b6a74a9 for instance with vm_state active and task_state deleting.
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-unplugged-ab42e005-7e8c-4b45-a30b-c4f1c743b3a4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-unplugged-ab42e005-7e8c-4b45-a30b-c4f1c743b3a4 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-unplugged-ab42e005-7e8c-4b45-a30b-c4f1c743b3a4 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-ab42e005-7e8c-4b45-a30b-c4f1c743b3a4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-ab42e005-7e8c-4b45-a30b-c4f1c743b3a4 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:09:59 user nova-compute[75293]: WARNING nova.compute.manager [req-f2f29fc1-9e45-4ac5-822d-e8b60bd9112d req-aa563824-3219-49fd-8589-f6862c032faf service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-ab42e005-7e8c-4b45-a30b-c4f1c743b3a4 for instance with vm_state active and task_state deleting.
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d329a8b2-a7cc-4be0-b001-223a38614716]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:09:59 user nova-compute[75293]: No targets found.
Nov 30 07:09:59 user nova-compute[75293]: iSNS:
Nov 30 07:09:59 user nova-compute[75293]: No targets found.
Nov 30 07:09:59 user nova-compute[75293]: STATIC:
Nov 30 07:09:59 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765
Nov 30 07:09:59 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:59 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:59 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c
Nov 30 07:09:59 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:59 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:59 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89
Nov 30 07:09:59 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:59 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:59 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50
Nov 30 07:09:59 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:59 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:59 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14
Nov 30 07:09:59 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:59 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:59 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51
Nov 30 07:09:59 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:59 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:59 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324
Nov 30 07:09:59 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:09:59 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:09:59 user nova-compute[75293]: FIRMWARE:
Nov 30 07:09:59 user nova-compute[75293]: No targets found.
Nov 30 07:09:59 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:09:59 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:09:59 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8f4269-3b98-4482-9daa-97389a4fa0f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-changed-fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Refreshing instance network info cache due to event network-changed-fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Acquiring lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Acquired lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG nova.network.neutron [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Refreshing network info cache for port fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f70e69a-12bf-4f92-aa21-2b4f374cd035]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:09:59 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe804f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14'): ({'sde'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Removing single pathed devices sde {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfcf1d7-4275-4e68-bc8a-589794e39877]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1deaa0b-6703-443a-8d0b-fc7e911c0739]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Flushing IO for device /dev/sde {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b363ef05-34fc-48c3-8cd2-a7810ddc7302]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.079s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2390ce5-66aa-45dd-b972-23ed0d2a671c]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] SCSI volumes sde have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[10560bd7-9080-46d8-86bf-e8b645c3bb6a]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:09:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c7dd62-d18f-46d7-8e79-3849d4a3d00e]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14, portal: 172.16.0.220,3260]
Nov 30 07:10:00 user nova-compute[75293]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14, portal: 172.16.0.220,3260] successful.
Nov 30 07:10:00 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178a4b07-0dd0-43e8-9303-99763655fc14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2de7b0-f1b9-44e2-897a-2294faa641db]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] <== disconnect_volume: return (391ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVDxHjWt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:10:00 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6022edd2-6e4d-4ad2-a63d-8e36bca879f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:10:00 user nova-compute[75293]: No targets found.
Nov 30 07:10:00 user nova-compute[75293]: iSNS:
Nov 30 07:10:00 user nova-compute[75293]: No targets found.
Nov 30 07:10:00 user nova-compute[75293]: STATIC:
Nov 30 07:10:00 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765
Nov 30 07:10:00 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:00 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:00 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c
Nov 30 07:10:00 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:00 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:00 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89
Nov 30 07:10:00 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:00 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:00 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50
Nov 30 07:10:00 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:00 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:00 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51
Nov 30 07:10:00 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:00 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:00 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324
Nov 30 07:10:00 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:00 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:00 user nova-compute[75293]: FIRMWARE:
Nov 30 07:10:00 user nova-compute[75293]: No targets found.
Nov 30 07:10:00 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:10:00 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:10:00 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[503351dc-29ff-4161-b46f-081f7e808739]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae689eb0-25bc-4646-84fb-3d9075f98b03]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:10:00 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:10:00 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:10:00 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:10:00 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:10:00 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:10:00 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:10:00 user nova-compute[75293]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 (non-flash)
Nov 30 07:10:00 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:10:00 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:10:00 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:10:00 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:10:00 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe0164a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50'): ({'sdb'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Removing single pathed devices sdb {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.network.neutron [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updated VIF entry in instance network info cache for port fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.network.neutron [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updating instance_info_cache with network_info: [{"id": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "address": "fa:16:3e:45:27:91", "network": {"id": "dcc0a646-3097-4d7c-8d41-a5cd415c9ec3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1268388523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb623d7c-b0", "ovs_interfaceid": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60e4fab9-df41-42dd-be40-1300f77a7d89", "address": "fa:16:3e:01:72:2a", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e4fab9-df", "ovs_interfaceid": "60e4fab9-df41-42dd-be40-1300f77a7d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b998882b-1d11-404b-930e-91b355ded504", "address": "fa:16:3e:82:f1:9d", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb998882b-1d", "ovs_interfaceid": "b998882b-1d11-404b-930e-91b355ded504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b73c69b2-9f21-4615-80a4-7676df8071bd", "address": "fa:16:3e:28:00:25", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73c69b2-9f", "ovs_interfaceid": "b73c69b2-9f21-4615-80a4-7676df8071bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "address": "fa:16:3e:c2:fb:c4", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666a23fb-99", "ovs_interfaceid": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb92875-8448-4085-8275-c9cb21d80edf", "address": "fa:16:3e:a5:35:29", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb92875-84", "ovs_interfaceid": "dbb92875-8448-4085-8275-c9cb21d80edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09043b02-fceb-424b-9f68-a526293780c2", "address": "fa:16:3e:82:90:d6", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09043b02-fc", "ovs_interfaceid": "09043b02-fceb-424b-9f68-a526293780c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c31dd6-2f17-4d31-b1fd-7fbd1363fad6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ba2633-96b5-4a29-93fa-4cffca926cde]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Flushing IO for device /dev/sdb {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b867e415-3d2d-4b04-bf21-cb63624b49b8]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Releasing lock "refresh_cache-cc583d29-3df4-4406-b5a5-f4b3d300fabb" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-e8aa8c23-b7b1-4fed-80e2-ab511875b253 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-e8aa8c23-b7b1-4fed-80e2-ab511875b253 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:00 user nova-compute[75293]: WARNING nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-e8aa8c23-b7b1-4fed-80e2-ab511875b253 for instance with vm_state active and task_state deleting.
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-unplugged-3d552b1b-e03f-49a7-9f26-50748172b6d0 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-unplugged-3d552b1b-e03f-49a7-9f26-50748172b6d0 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-unplugged-3d552b1b-e03f-49a7-9f26-50748172b6d0 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-3d552b1b-e03f-49a7-9f26-50748172b6d0 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-3d552b1b-e03f-49a7-9f26-50748172b6d0 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:00 user nova-compute[75293]: WARNING nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-3d552b1b-e03f-49a7-9f26-50748172b6d0 for instance with vm_state active and task_state deleting.
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-unplugged-a746d18c-574c-4c72-b3af-c5d7d6387f9c {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-unplugged-a746d18c-574c-4c72-b3af-c5d7d6387f9c {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-unplugged-a746d18c-574c-4c72-b3af-c5d7d6387f9c for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-a746d18c-574c-4c72-b3af-c5d7d6387f9c {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-a746d18c-574c-4c72-b3af-c5d7d6387f9c {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:00 user nova-compute[75293]: WARNING nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-a746d18c-574c-4c72-b3af-c5d7d6387f9c for instance with vm_state active and task_state deleting.
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-unplugged-177273b3-02d1-4f5c-ae31-70103280dd88 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-unplugged-177273b3-02d1-4f5c-ae31-70103280dd88 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-unplugged-177273b3-02d1-4f5c-ae31-70103280dd88 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-plugged-177273b3-02d1-4f5c-ae31-70103280dd88 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Acquiring lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] No waiting events found dispatching network-vif-plugged-177273b3-02d1-4f5c-ae31-70103280dd88 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:00 user nova-compute[75293]: WARNING nova.compute.manager [req-282790a0-e75a-4104-9062-3e2f3b218fe6 req-c5cf9bab-d7b6-4f98-89fe-367457eab5ba service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received unexpected event network-vif-plugged-177273b3-02d1-4f5c-ae31-70103280dd88 for instance with vm_state active and task_state deleting.
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5746fa8-fcd8-4d28-8813-d8253dcc39a8]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cc37d9-590c-44fc-830e-2e6b3ae9f99b]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13152de-a57e-481e-87a0-c7174c2b8116]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50, portal: 172.16.0.220,3260]
Nov 30 07:10:00 user nova-compute[75293]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50, portal: 172.16.0.220,3260] successful.
Nov 30 07:10:00 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58d71501-6e63-4411-b9fc-c951d0c71f50 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81d678d-8aa1-4b53-afe5-78fcd9dc2487]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] <== disconnect_volume: return (352ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSBQCLqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:10:00 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9d4d4d-87b2-4328-8162-17690734423b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:10:00 user nova-compute[75293]: No targets found.
Nov 30 07:10:00 user nova-compute[75293]: iSNS:
Nov 30 07:10:00 user nova-compute[75293]: No targets found.
Nov 30 07:10:00 user nova-compute[75293]: STATIC:
Nov 30 07:10:00 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765
Nov 30 07:10:00 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:00 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:00 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c
Nov 30 07:10:00 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:00 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:00 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89
Nov 30 07:10:00 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:00 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:00 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51
Nov 30 07:10:00 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:00 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:00 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324
Nov 30 07:10:00 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:00 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:00 user nova-compute[75293]: FIRMWARE:
Nov 30 07:10:00 user nova-compute[75293]: No targets found.
Nov 30 07:10:00 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:10:00 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:10:00 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[180b5d7e-975d-4f2f-b95d-cb44bf3f2789]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[249f68f7-88a3-49b9-9113-ff23a1e7e0e9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:10:00 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:10:00 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:10:00 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:10:00 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:10:00 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:10:00 user nova-compute[75293]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 (non-flash)
Nov 30 07:10:00 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:10:00 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:10:00 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:10:00 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe0164a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765'): ({'sdc'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Removing single pathed devices sdc {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f0d097-f9d4-4545-be9d-0f88b1e97d21]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c188dc2-e261-4a41-883a-3f62d3e23cfe]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Flushing IO for device /dev/sdc {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c0efe2-2a15-44db-94b5-427585347183]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6f0875-60e9-4d6b-804d-8a7b9c86d918]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a9d76e-e119-41b0-b224-b5a92b74a526]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[071f36c1-fa38-47ef-beca-9140558d9dbd]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765, portal: 172.16.0.220,3260]
Nov 30 07:10:00 user nova-compute[75293]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765, portal: 172.16.0.220,3260] successful.
Nov 30 07:10:00 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5917ae-7628-4e29-a1af-dea190f86765 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c832f15-b5af-4072-8ae0-412b55dda991]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] <== disconnect_volume: return (323ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:10:00 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Deleting instance files /opt/stack/data/nova/instances/09b63cd9-2f63-411d-886d-3ff237d145d0_del
Nov 30 07:10:00 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Deletion of /opt/stack/data/nova/instances/09b63cd9-2f63-411d-886d-3ff237d145d0_del complete
Nov 30 07:10:00 user nova-compute[75293]: INFO nova.compute.manager [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Took 4.03 seconds to destroy the instance on the hypervisor.
Nov 30 07:10:00 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:10:00 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:01 user nova-compute[75293]: INFO nova.compute.manager [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Terminating instance
Nov 30 07:10:01 user nova-compute[75293]: DEBUG nova.compute.manager [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG nova.compute.manager [req-a24357d8-3dcb-443b-ba1d-60f3d6fae059 req-80877a7c-47f1-4f37-b737-60f0cc2dcd2f service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-unplugged-fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a24357d8-3dcb-443b-ba1d-60f3d6fae059 req-80877a7c-47f1-4f37-b737-60f0cc2dcd2f service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a24357d8-3dcb-443b-ba1d-60f3d6fae059 req-80877a7c-47f1-4f37-b737-60f0cc2dcd2f service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a24357d8-3dcb-443b-ba1d-60f3d6fae059 req-80877a7c-47f1-4f37-b737-60f0cc2dcd2f service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG nova.compute.manager [req-a24357d8-3dcb-443b-ba1d-60f3d6fae059 req-80877a7c-47f1-4f37-b737-60f0cc2dcd2f service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-unplugged-fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG nova.compute.manager [req-a24357d8-3dcb-443b-ba1d-60f3d6fae059 req-80877a7c-47f1-4f37-b737-60f0cc2dcd2f service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-unplugged-fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG nova.compute.manager [req-2e1e582a-847d-4682-9205-2429d10b3fd1 req-2942aa2b-05ed-425c-97b9-a4a1e4d11a3a service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-unplugged-b73c69b2-9f21-4615-80a4-7676df8071bd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2e1e582a-847d-4682-9205-2429d10b3fd1 req-2942aa2b-05ed-425c-97b9-a4a1e4d11a3a service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2e1e582a-847d-4682-9205-2429d10b3fd1 req-2942aa2b-05ed-425c-97b9-a4a1e4d11a3a service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2e1e582a-847d-4682-9205-2429d10b3fd1 req-2942aa2b-05ed-425c-97b9-a4a1e4d11a3a service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG nova.compute.manager [req-2e1e582a-847d-4682-9205-2429d10b3fd1 req-2942aa2b-05ed-425c-97b9-a4a1e4d11a3a service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-unplugged-b73c69b2-9f21-4615-80a4-7676df8071bd {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG nova.compute.manager [req-2e1e582a-847d-4682-9205-2429d10b3fd1 req-2942aa2b-05ed-425c-97b9-a4a1e4d11a3a service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-unplugged-b73c69b2-9f21-4615-80a4-7676df8071bd for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG nova.compute.manager [req-d4a03517-b8fc-4db3-b013-4ec2a41ea888 req-449901e5-48a3-4fea-a0a4-4bc4f6c402b2 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-unplugged-666a23fb-99db-4762-9181-18e0fbbbfdf2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d4a03517-b8fc-4db3-b013-4ec2a41ea888 req-449901e5-48a3-4fea-a0a4-4bc4f6c402b2 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d4a03517-b8fc-4db3-b013-4ec2a41ea888 req-449901e5-48a3-4fea-a0a4-4bc4f6c402b2 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d4a03517-b8fc-4db3-b013-4ec2a41ea888 req-449901e5-48a3-4fea-a0a4-4bc4f6c402b2 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG nova.compute.manager [req-d4a03517-b8fc-4db3-b013-4ec2a41ea888 req-449901e5-48a3-4fea-a0a4-4bc4f6c402b2 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-unplugged-666a23fb-99db-4762-9181-18e0fbbbfdf2 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG nova.compute.manager [req-d4a03517-b8fc-4db3-b013-4ec2a41ea888 req-449901e5-48a3-4fea-a0a4-4bc4f6c402b2 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-unplugged-666a23fb-99db-4762-9181-18e0fbbbfdf2 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:10:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:02 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Instance destroyed successfully.
Nov 30 07:10:02 user nova-compute[75293]: DEBUG nova.objects.instance [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lazy-loading 'resources' on Instance uuid cc583d29-3df4-4406-b5a5-f4b3d300fabb {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:08:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:08:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "address": "fa:16:3e:45:27:91", "network": {"id": "dcc0a646-3097-4d7c-8d41-a5cd415c9ec3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1268388523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb623d7c-b0", "ovs_interfaceid": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "address": "fa:16:3e:45:27:91", "network": {"id": "dcc0a646-3097-4d7c-8d41-a5cd415c9ec3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1268388523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb623d7c-b0", "ovs_interfaceid": "fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:27:91,bridge_name='br-int',has_traffic_filtering=True,id=fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6,network=Network(dcc0a646-3097-4d7c-8d41-a5cd415c9ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb623d7c-b0') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG os_vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:27:91,bridge_name='br-int',has_traffic_filtering=True,id=fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6,network=Network(dcc0a646-3097-4d7c-8d41-a5cd415c9ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb623d7c-b0') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb623d7c-b0, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2df649b5-1e88-490d-8a54-5c5fc4654842) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:02 user nova-compute[75293]: INFO os_vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:27:91,bridge_name='br-int',has_traffic_filtering=True,id=fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6,network=Network(dcc0a646-3097-4d7c-8d41-a5cd415c9ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb623d7c-b0')
Nov 30 07:10:02 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:08:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:08:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60e4fab9-df41-42dd-be40-1300f77a7d89", "address": "fa:16:3e:01:72:2a", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e4fab9-df", "ovs_interfaceid": "60e4fab9-df41-42dd-be40-1300f77a7d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "60e4fab9-df41-42dd-be40-1300f77a7d89", "address": "fa:16:3e:01:72:2a", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e4fab9-df", "ovs_interfaceid": "60e4fab9-df41-42dd-be40-1300f77a7d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:72:2a,bridge_name='br-int',has_traffic_filtering=True,id=60e4fab9-df41-42dd-be40-1300f77a7d89,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60e4fab9-df') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG os_vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:72:2a,bridge_name='br-int',has_traffic_filtering=True,id=60e4fab9-df41-42dd-be40-1300f77a7d89,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60e4fab9-df') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60e4fab9-df, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c4dbe6b-743e-48c0-9980-08b9b3e3f164) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: INFO os_vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:72:2a,bridge_name='br-int',has_traffic_filtering=True,id=60e4fab9-df41-42dd-be40-1300f77a7d89,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60e4fab9-df')
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:08:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:08:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b998882b-1d11-404b-930e-91b355ded504", "address": "fa:16:3e:82:f1:9d", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb998882b-1d", "ovs_interfaceid": "b998882b-1d11-404b-930e-91b355ded504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "b998882b-1d11-404b-930e-91b355ded504", "address": "fa:16:3e:82:f1:9d", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb998882b-1d", "ovs_interfaceid": "b998882b-1d11-404b-930e-91b355ded504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=b998882b-1d11-404b-930e-91b355ded504,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb998882b-1d') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=b998882b-1d11-404b-930e-91b355ded504,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb998882b-1d') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb998882b-1d, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=982dd283-6867-454f-bb4b-89f98a3b5338) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: INFO os_vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=b998882b-1d11-404b-930e-91b355ded504,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb998882b-1d')
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:08:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:08:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b73c69b2-9f21-4615-80a4-7676df8071bd", "address": "fa:16:3e:28:00:25", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73c69b2-9f", "ovs_interfaceid": "b73c69b2-9f21-4615-80a4-7676df8071bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "b73c69b2-9f21-4615-80a4-7676df8071bd", "address": "fa:16:3e:28:00:25", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73c69b2-9f", "ovs_interfaceid": "b73c69b2-9f21-4615-80a4-7676df8071bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:00:25,bridge_name='br-int',has_traffic_filtering=True,id=b73c69b2-9f21-4615-80a4-7676df8071bd,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73c69b2-9f') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:00:25,bridge_name='br-int',has_traffic_filtering=True,id=b73c69b2-9f21-4615-80a4-7676df8071bd,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73c69b2-9f') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb73c69b2-9f, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85ff6286-47e0-4249-94c7-2ce091113950) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: INFO os_vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:00:25,bridge_name='br-int',has_traffic_filtering=True,id=b73c69b2-9f21-4615-80a4-7676df8071bd,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73c69b2-9f')
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:08:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:08:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "address": "fa:16:3e:c2:fb:c4", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666a23fb-99", "ovs_interfaceid": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "address": "fa:16:3e:c2:fb:c4", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666a23fb-99", "ovs_interfaceid": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:fb:c4,bridge_name='br-int',has_traffic_filtering=True,id=666a23fb-99db-4762-9181-18e0fbbbfdf2,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666a23fb-99') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:fb:c4,bridge_name='br-int',has_traffic_filtering=True,id=666a23fb-99db-4762-9181-18e0fbbbfdf2,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666a23fb-99') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap666a23fb-99, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43c77f58-cf81-4f16-b902-4c4965d6f0df) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: INFO os_vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:fb:c4,bridge_name='br-int',has_traffic_filtering=True,id=666a23fb-99db-4762-9181-18e0fbbbfdf2,network=Network(8a03fdb7-2f18-4db2-ad62-b75493779c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666a23fb-99')
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:08:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:08:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbb92875-8448-4085-8275-c9cb21d80edf", "address": "fa:16:3e:a5:35:29", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb92875-84", "ovs_interfaceid": "dbb92875-8448-4085-8275-c9cb21d80edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "dbb92875-8448-4085-8275-c9cb21d80edf", "address": "fa:16:3e:a5:35:29", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb92875-84", "ovs_interfaceid": "dbb92875-8448-4085-8275-c9cb21d80edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:35:29,bridge_name='br-int',has_traffic_filtering=True,id=dbb92875-8448-4085-8275-c9cb21d80edf,network=Network(648a2400-b581-4a51-a2f6-df676910ceee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb92875-84') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:35:29,bridge_name='br-int',has_traffic_filtering=True,id=dbb92875-8448-4085-8275-c9cb21d80edf,network=Network(648a2400-b581-4a51-a2f6-df676910ceee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb92875-84') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbb92875-84, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38e0aeeb-3ca2-4a65-9ef2-6b0681b10295) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: INFO os_vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:35:29,bridge_name='br-int',has_traffic_filtering=True,id=dbb92875-8448-4085-8275-c9cb21d80edf,network=Network(648a2400-b581-4a51-a2f6-df676910ceee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb92875-84')
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1359238201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1359238201',id=12,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoK7Sj/U7Q9oSrTcDL8N30qnk2EheltKZQCSV1MLnvNY8L3mdE1uH3iEO6np6gFKdr/a8s/54yh6Zc1A9fLO7hqqjculQF5r8/qfCJYAGb6hukaOr6ogd2+CaWB5cXSCQ==',key_name='tempest-keypair-1353445246',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:08:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0b4aec4e9794fa1bedce064018cc3a4',ramdisk_id='',reservation_id='r-se1nb2q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1204410285',owner_user_name='tempest-TaggedBootDevicesTest_v242-1204410285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:08:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7754783efd654868ab533fc179a7a485',uuid=cc583d29-3df4-4406-b5a5-f4b3d300fabb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09043b02-fceb-424b-9f68-a526293780c2", "address": "fa:16:3e:82:90:d6", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09043b02-fc", "ovs_interfaceid": "09043b02-fceb-424b-9f68-a526293780c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converting VIF {"id": "09043b02-fceb-424b-9f68-a526293780c2", "address": "fa:16:3e:82:90:d6", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09043b02-fc", "ovs_interfaceid": "09043b02-fceb-424b-9f68-a526293780c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:90:d6,bridge_name='br-int',has_traffic_filtering=True,id=09043b02-fceb-424b-9f68-a526293780c2,network=Network(648a2400-b581-4a51-a2f6-df676910ceee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09043b02-fc') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:90:d6,bridge_name='br-int',has_traffic_filtering=True,id=09043b02-fceb-424b-9f68-a526293780c2,network=Network(648a2400-b581-4a51-a2f6-df676910ceee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09043b02-fc') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09043b02-fc, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da1e1ece-68e3-4df6-a8ea-cb19f0ab310a) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:03 user nova-compute[75293]: INFO os_vif [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:90:d6,bridge_name='br-int',has_traffic_filtering=True,id=09043b02-fceb-424b-9f68-a526293780c2,network=Network(648a2400-b581-4a51-a2f6-df676910ceee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09043b02-fc')
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEqsjIOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:10:03 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:03 user nova-compute[75293]: WARNING nova.compute.manager [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6 for instance with vm_state active and task_state deleting.
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-unplugged-60e4fab9-df41-42dd-be40-1300f77a7d89 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-unplugged-60e4fab9-df41-42dd-be40-1300f77a7d89 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-unplugged-60e4fab9-df41-42dd-be40-1300f77a7d89 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-60e4fab9-df41-42dd-be40-1300f77a7d89 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-60e4fab9-df41-42dd-be40-1300f77a7d89 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:03 user nova-compute[75293]: WARNING nova.compute.manager [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-60e4fab9-df41-42dd-be40-1300f77a7d89 for instance with vm_state active and task_state deleting.
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-unplugged-b998882b-1d11-404b-930e-91b355ded504 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-unplugged-b998882b-1d11-404b-930e-91b355ded504 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-unplugged-b998882b-1d11-404b-930e-91b355ded504 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-b998882b-1d11-404b-930e-91b355ded504 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-b998882b-1d11-404b-930e-91b355ded504 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:03 user nova-compute[75293]: WARNING nova.compute.manager [req-6db4d413-edf7-4a9d-8347-9a70667606b5 req-768aec7d-5bd4-4e9a-923c-6209e6cac201 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-b998882b-1d11-404b-930e-91b355ded504 for instance with vm_state active and task_state deleting.
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f8cc05-6af4-4bdc-b073-a942b81ba0ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:10:03 user nova-compute[75293]: No targets found.
Nov 30 07:10:03 user nova-compute[75293]: iSNS:
Nov 30 07:10:03 user nova-compute[75293]: No targets found.
Nov 30 07:10:03 user nova-compute[75293]: STATIC:
Nov 30 07:10:03 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c
Nov 30 07:10:03 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:03 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:03 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89
Nov 30 07:10:03 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:03 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:03 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51
Nov 30 07:10:03 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:03 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:03 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324
Nov 30 07:10:03 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:03 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:03 user nova-compute[75293]: FIRMWARE:
Nov 30 07:10:03 user nova-compute[75293]: No targets found.
Nov 30 07:10:03 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:10:03 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:10:03 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf58028c-b707-4773-a38d-da6a75a1ccf8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9f6c55-ba8c-4a26-8286-665e6be15d94]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:10:03 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:10:03 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:10:03 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:10:03 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:10:03 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:10:03 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:10:03 user nova-compute[75293]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 (non-flash)
Nov 30 07:10:03 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effc87bdcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51'): ({'sdg'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Removing single pathed devices sdg {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0968dd3d-6cb2-42d8-b3cd-455d795faa08]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1348b59d-ed10-4baf-a318-945a10898689]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Flushing IO for device /dev/sdg {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa7606d-de96-4dc9-b9b8-70bcbd3be961]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb59bcf3-2488-4ede-9b0b-5f1004bb3a24]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] SCSI volumes sdg have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c139921f-109c-4951-a186-dba3dc555390]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa80c85-7f07-4146-9a61-1e7719f3cca4]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51, portal: 172.16.0.220,3260]
Nov 30 07:10:03 user nova-compute[75293]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51, portal: 172.16.0.220,3260] successful.
Nov 30 07:10:03 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb80b1dd-cfed-46f4-a524-f66fda55bf51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f21214f-7bca-4729-bb1c-7802ff986795]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] <== disconnect_volume: return (303ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egiQsvFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:10:03 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[14748493-46dd-4926-a022-22821ea7f085]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:10:03 user nova-compute[75293]: No targets found.
Nov 30 07:10:03 user nova-compute[75293]: iSNS:
Nov 30 07:10:03 user nova-compute[75293]: No targets found.
Nov 30 07:10:03 user nova-compute[75293]: STATIC:
Nov 30 07:10:03 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c
Nov 30 07:10:03 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:03 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:03 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89
Nov 30 07:10:03 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:03 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:03 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324
Nov 30 07:10:03 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:03 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:03 user nova-compute[75293]: FIRMWARE:
Nov 30 07:10:03 user nova-compute[75293]: No targets found.
Nov 30 07:10:03 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:10:03 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:10:03 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab6d063-b95e-47ee-a432-0c667c0f0d10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b281c850-d300-47ce-b1e6-8de37161f4c3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:10:03 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:10:03 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:10:03 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:10:03 user nova-compute[75293]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c (non-flash)
Nov 30 07:10:03 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:10:03 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effc87e57e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c'): ({'sdd'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Removing single pathed devices sdd {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c677b988-9d9b-4948-8a39-8a2e0c3b7869]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf3ece9-1421-4a73-bfcb-3dd77bb15cfe]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Flushing IO for device /dev/sdd {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24c7e2b-dcba-4b2d-9f1b-a1d2df6fdc87]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5063c476-bf31-48a7-8193-550fe2d81882]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] SCSI volumes sdd have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd58a30-720d-4362-8b1c-1477156e4e40]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-210eead4-4228-4f23-bd46-62729f00b7bb req-c0af962a-077c-43ac-97d0-8a43e6e12692 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-666a23fb-99db-4762-9181-18e0fbbbfdf2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-210eead4-4228-4f23-bd46-62729f00b7bb req-c0af962a-077c-43ac-97d0-8a43e6e12692 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-210eead4-4228-4f23-bd46-62729f00b7bb req-c0af962a-077c-43ac-97d0-8a43e6e12692 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-210eead4-4228-4f23-bd46-62729f00b7bb req-c0af962a-077c-43ac-97d0-8a43e6e12692 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-210eead4-4228-4f23-bd46-62729f00b7bb req-c0af962a-077c-43ac-97d0-8a43e6e12692 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-666a23fb-99db-4762-9181-18e0fbbbfdf2 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:03 user nova-compute[75293]: WARNING nova.compute.manager [req-210eead4-4228-4f23-bd46-62729f00b7bb req-c0af962a-077c-43ac-97d0-8a43e6e12692 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-666a23fb-99db-4762-9181-18e0fbbbfdf2 for instance with vm_state active and task_state deleting.
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-210eead4-4228-4f23-bd46-62729f00b7bb req-c0af962a-077c-43ac-97d0-8a43e6e12692 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-unplugged-09043b02-fceb-424b-9f68-a526293780c2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-210eead4-4228-4f23-bd46-62729f00b7bb req-c0af962a-077c-43ac-97d0-8a43e6e12692 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-210eead4-4228-4f23-bd46-62729f00b7bb req-c0af962a-077c-43ac-97d0-8a43e6e12692 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-210eead4-4228-4f23-bd46-62729f00b7bb req-c0af962a-077c-43ac-97d0-8a43e6e12692 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-210eead4-4228-4f23-bd46-62729f00b7bb req-c0af962a-077c-43ac-97d0-8a43e6e12692 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-unplugged-09043b02-fceb-424b-9f68-a526293780c2 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-210eead4-4228-4f23-bd46-62729f00b7bb req-c0af962a-077c-43ac-97d0-8a43e6e12692 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-unplugged-09043b02-fceb-424b-9f68-a526293780c2 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-210eead4-4228-4f23-bd46-62729f00b7bb req-c0af962a-077c-43ac-97d0-8a43e6e12692 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-09043b02-fceb-424b-9f68-a526293780c2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-210eead4-4228-4f23-bd46-62729f00b7bb req-c0af962a-077c-43ac-97d0-8a43e6e12692 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-210eead4-4228-4f23-bd46-62729f00b7bb req-c0af962a-077c-43ac-97d0-8a43e6e12692 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-210eead4-4228-4f23-bd46-62729f00b7bb req-c0af962a-077c-43ac-97d0-8a43e6e12692 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-210eead4-4228-4f23-bd46-62729f00b7bb req-c0af962a-077c-43ac-97d0-8a43e6e12692 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-09043b02-fceb-424b-9f68-a526293780c2 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:03 user nova-compute[75293]: WARNING nova.compute.manager [req-210eead4-4228-4f23-bd46-62729f00b7bb req-c0af962a-077c-43ac-97d0-8a43e6e12692 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-09043b02-fceb-424b-9f68-a526293780c2 for instance with vm_state active and task_state deleting.
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-b73c69b2-9f21-4615-80a4-7676df8071bd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-b73c69b2-9f21-4615-80a4-7676df8071bd {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:03 user nova-compute[75293]: WARNING nova.compute.manager [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-b73c69b2-9f21-4615-80a4-7676df8071bd for instance with vm_state active and task_state deleting.
Nov 30 07:10:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-unplugged-dbb92875-8448-4085-8275-c9cb21d80edf {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-unplugged-dbb92875-8448-4085-8275-c9cb21d80edf {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-unplugged-dbb92875-8448-4085-8275-c9cb21d80edf for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-plugged-dbb92875-8448-4085-8275-c9cb21d80edf {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] Acquiring lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] No waiting events found dispatching network-vif-plugged-dbb92875-8448-4085-8275-c9cb21d80edf {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:04 user nova-compute[75293]: WARNING nova.compute.manager [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received unexpected event network-vif-plugged-dbb92875-8448-4085-8275-c9cb21d80edf for instance with vm_state active and task_state deleting.
Nov 30 07:10:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-deleted-ab42e005-7e8c-4b45-a30b-c4f1c743b3a4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:04 user nova-compute[75293]: INFO nova.compute.manager [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Neutron deleted interface ab42e005-7e8c-4b45-a30b-c4f1c743b3a4; detaching it from the instance and deleting it from the info cache
Nov 30 07:10:04 user nova-compute[75293]: DEBUG nova.network.neutron [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Updating instance_info_cache with network_info: [{"id": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "address": "fa:16:3e:03:dc:1e", "network": {"id": "d6d10985-38b5-4e72-9276-76a246a2275e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1743986748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef61853-62", "ovs_interfaceid": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "address": "fa:16:3e:5f:38:ec", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa8c23-b7", "ovs_interfaceid": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "address": "fa:16:3e:12:ac:0e", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d552b1b-e0", "ovs_interfaceid": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "address": "fa:16:3e:a2:e2:22", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ac9e07-c0", "ovs_interfaceid": "b9ac9e07-c027-4b26-ab1f-fe548b6a74a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "address": "fa:16:3e:4b:ef:61", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa746d18c-57", "ovs_interfaceid": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "177273b3-02d1-4f5c-ae31-70103280dd88", "address": "fa:16:3e:d3:53:db", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177273b3-02", "ovs_interfaceid": "177273b3-02d1-4f5c-ae31-70103280dd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2b6741-5fd2-439d-8e70-ef816bb7a4fe]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c, portal: 172.16.0.220,3260]
Nov 30 07:10:04 user nova-compute[75293]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c, portal: 172.16.0.220,3260] successful.
Nov 30 07:10:04 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Detach interface failed, port_id=ab42e005-7e8c-4b45-a30b-c4f1c743b3a4, reason: Instance 09b63cd9-2f63-411d-886d-3ff237d145d0 could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-deleted-b9ac9e07-c027-4b26-ab1f-fe548b6a74a9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:04 user nova-compute[75293]: INFO nova.compute.manager [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Neutron deleted interface b9ac9e07-c027-4b26-ab1f-fe548b6a74a9; detaching it from the instance and deleting it from the info cache
Nov 30 07:10:04 user nova-compute[75293]: DEBUG nova.network.neutron [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Updating instance_info_cache with network_info: [{"id": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "address": "fa:16:3e:03:dc:1e", "network": {"id": "d6d10985-38b5-4e72-9276-76a246a2275e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1743986748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ef61853-62", "ovs_interfaceid": "5ef61853-620c-45df-9e8c-7ff595aecdf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "address": "fa:16:3e:5f:38:ec", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa8c23-b7", "ovs_interfaceid": "e8aa8c23-b7b1-4fed-80e2-ab511875b253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "address": "fa:16:3e:12:ac:0e", "network": {"id": "3d697058-892a-4743-99b8-4e02fc775577", "bridge": "br-int", "label": "tempest-device-tagging-net1-1658786876", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d552b1b-e0", "ovs_interfaceid": "3d552b1b-e03f-49a7-9f26-50748172b6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "address": "fa:16:3e:4b:ef:61", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa746d18c-57", "ovs_interfaceid": "a746d18c-574c-4c72-b3af-c5d7d6387f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "177273b3-02d1-4f5c-ae31-70103280dd88", "address": "fa:16:3e:d3:53:db", "network": {"id": "3c6d9467-49b6-456e-ac11-0c7286c2b773", "bridge": "br-int", "label": "tempest-device-tagging-net2-1059292392", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f62b7927ac1e441ca0897d81a5bb527e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177273b3-02", "ovs_interfaceid": "177273b3-02d1-4f5c-ae31-70103280dd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d46660fa-08d4-4b31-b4ca-3866a550c88c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc18ed0-70a3-4d6f-bda7-65c2b4145148]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] <== disconnect_volume: return (296ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-c0fed098-b92f-467c-b08d-1a1ef8b0eeba req-b769a2e4-bcef-45ce-b9ad-0e142ec6d1b3 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Detach interface failed, port_id=b9ac9e07-c027-4b26-ab1f-fe548b6a74a9, reason: Instance 09b63cd9-2f63-411d-886d-3ff237d145d0 could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNOSmAkq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:10:04 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8c1312-bd79-46ca-9bbf-fe4e55d1e8da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:10:04 user nova-compute[75293]: No targets found.
Nov 30 07:10:04 user nova-compute[75293]: iSNS:
Nov 30 07:10:04 user nova-compute[75293]: No targets found.
Nov 30 07:10:04 user nova-compute[75293]: STATIC:
Nov 30 07:10:04 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89
Nov 30 07:10:04 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:04 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:04 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324
Nov 30 07:10:04 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:04 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:04 user nova-compute[75293]: FIRMWARE:
Nov 30 07:10:04 user nova-compute[75293]: No targets found.
Nov 30 07:10:04 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:10:04 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:10:04 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df81ccb-c1dd-4272-aa57-22cf7d94f59c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd8669a-0557-477f-a04b-43b0e7274fe8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:10:04 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:10:04 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:10:04 user nova-compute[75293]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 (non-flash)
Nov 30 07:10:04 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe808dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89'): ({'sdf'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Removing single pathed devices sdf {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07bd0c7-0db4-49aa-80e8-148108c4a3f7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d5f733-0934-49c8-a91a-77c639b4095c]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Flushing IO for device /dev/sdf {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd70a0c-5679-4fd0-9b47-c59190d7af2f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b275b9e7-78ae-49f0-b4ce-5c05b5b2987a]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] SCSI volumes sdf have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaad9d8-d689-41df-9015-73f8bf97f96c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8864a98b-f98e-451c-8ecc-7c5aa1212db3]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89, portal: 172.16.0.220,3260]
Nov 30 07:10:04 user nova-compute[75293]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89, portal: 172.16.0.220,3260] successful.
Nov 30 07:10:04 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f80c421f-f8ec-4cc7-86ee-59ef34a74c89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cece6e96-1751-4231-965f-6fd5f44a69b8]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] <== disconnect_volume: return (278ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:10:04 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Deleting instance files /opt/stack/data/nova/instances/cc583d29-3df4-4406-b5a5-f4b3d300fabb_del
Nov 30 07:10:04 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Deletion of /opt/stack/data/nova/instances/cc583d29-3df4-4406-b5a5-f4b3d300fabb_del complete
Nov 30 07:10:04 user nova-compute[75293]: INFO nova.compute.manager [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Took 3.40 seconds to destroy the instance on the hypervisor.
Nov 30 07:10:04 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:10:04 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:10:05 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:05 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Took 4.39 seconds to deallocate network for instance.
Nov 30 07:10:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-c3f8056c-aa11-4188-8f58-cd5fadcae8cc req-f1152e46-b71f-4806-990d-aeb925fa2d52 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-deleted-a746d18c-574c-4c72-b3af-c5d7d6387f9c {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-c3f8056c-aa11-4188-8f58-cd5fadcae8cc req-f1152e46-b71f-4806-990d-aeb925fa2d52 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-deleted-5ef61853-620c-45df-9e8c-7ff595aecdf1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-c3f8056c-aa11-4188-8f58-cd5fadcae8cc req-f1152e46-b71f-4806-990d-aeb925fa2d52 service nova] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Received event network-vif-deleted-177273b3-02d1-4f5c-ae31-70103280dd88 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:07 user nova-compute[75293]: DEBUG nova.objects.instance [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Lazy-loading 'flavor' on Instance uuid ca1e65f3-8696-4c9a-b4df-ce5923e1de31 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:10:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-df78af36-a90a-4257-ba2f-d8542593cea0 tempest-VolumesAssistedSnapshotsTest-901735925 tempest-VolumesAssistedSnapshotsTest-901735925-project-admin] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.669s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:07 user nova-compute[75293]: INFO nova.compute.manager [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] [instance: 09b63cd9-2f63-411d-886d-3ff237d145d0] Took 2.60 seconds to detach 3 volumes for instance.
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-c6455254-c8f0-471e-82ae-7f700560236b req-dc39c445-8ba3-4b8c-bb38-385c050077bc service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-deleted-fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:08 user nova-compute[75293]: INFO nova.compute.manager [req-c6455254-c8f0-471e-82ae-7f700560236b req-dc39c445-8ba3-4b8c-bb38-385c050077bc service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Neutron deleted interface fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6; detaching it from the instance and deleting it from the info cache
Nov 30 07:10:08 user nova-compute[75293]: DEBUG nova.network.neutron [req-c6455254-c8f0-471e-82ae-7f700560236b req-dc39c445-8ba3-4b8c-bb38-385c050077bc service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updating instance_info_cache with network_info: [{"id": "60e4fab9-df41-42dd-be40-1300f77a7d89", "address": "fa:16:3e:01:72:2a", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e4fab9-df", "ovs_interfaceid": "60e4fab9-df41-42dd-be40-1300f77a7d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b998882b-1d11-404b-930e-91b355ded504", "address": "fa:16:3e:82:f1:9d", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb998882b-1d", "ovs_interfaceid": "b998882b-1d11-404b-930e-91b355ded504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b73c69b2-9f21-4615-80a4-7676df8071bd", "address": "fa:16:3e:28:00:25", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73c69b2-9f", "ovs_interfaceid": "b73c69b2-9f21-4615-80a4-7676df8071bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "address": "fa:16:3e:c2:fb:c4", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666a23fb-99", "ovs_interfaceid": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbb92875-8448-4085-8275-c9cb21d80edf", "address": "fa:16:3e:a5:35:29", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb92875-84", "ovs_interfaceid": "dbb92875-8448-4085-8275-c9cb21d80edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09043b02-fceb-424b-9f68-a526293780c2", "address": "fa:16:3e:82:90:d6", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09043b02-fc", "ovs_interfaceid": "09043b02-fceb-424b-9f68-a526293780c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-c6455254-c8f0-471e-82ae-7f700560236b req-dc39c445-8ba3-4b8c-bb38-385c050077bc service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Detach interface failed, port_id=fb623d7c-b0e7-41d7-bec7-eb8d5e1da3c6, reason: Instance cc583d29-3df4-4406-b5a5-f4b3d300fabb could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-c6455254-c8f0-471e-82ae-7f700560236b req-dc39c445-8ba3-4b8c-bb38-385c050077bc service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-deleted-dbb92875-8448-4085-8275-c9cb21d80edf {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:08 user nova-compute[75293]: INFO nova.compute.manager [req-c6455254-c8f0-471e-82ae-7f700560236b req-dc39c445-8ba3-4b8c-bb38-385c050077bc service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Neutron deleted interface dbb92875-8448-4085-8275-c9cb21d80edf; detaching it from the instance and deleting it from the info cache
Nov 30 07:10:08 user nova-compute[75293]: DEBUG nova.network.neutron [req-c6455254-c8f0-471e-82ae-7f700560236b req-dc39c445-8ba3-4b8c-bb38-385c050077bc service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updating instance_info_cache with network_info: [{"id": "60e4fab9-df41-42dd-be40-1300f77a7d89", "address": "fa:16:3e:01:72:2a", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e4fab9-df", "ovs_interfaceid": "60e4fab9-df41-42dd-be40-1300f77a7d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b998882b-1d11-404b-930e-91b355ded504", "address": "fa:16:3e:82:f1:9d", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb998882b-1d", "ovs_interfaceid": "b998882b-1d11-404b-930e-91b355ded504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b73c69b2-9f21-4615-80a4-7676df8071bd", "address": "fa:16:3e:28:00:25", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73c69b2-9f", "ovs_interfaceid": "b73c69b2-9f21-4615-80a4-7676df8071bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "address": "fa:16:3e:c2:fb:c4", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666a23fb-99", "ovs_interfaceid": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "09043b02-fceb-424b-9f68-a526293780c2", "address": "fa:16:3e:82:90:d6", "network": {"id": "648a2400-b581-4a51-a2f6-df676910ceee", "bridge": "br-int", "label": "tempest-device-tagging-net2-386683381", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09043b02-fc", "ovs_interfaceid": "09043b02-fceb-424b-9f68-a526293780c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZSPGysY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:10:08 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:10:08 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:10:08 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-c6455254-c8f0-471e-82ae-7f700560236b req-dc39c445-8ba3-4b8c-bb38-385c050077bc service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Detach interface failed, port_id=dbb92875-8448-4085-8275-c9cb21d80edf, reason: Instance cc583d29-3df4-4406-b5a5-f4b3d300fabb could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-c6455254-c8f0-471e-82ae-7f700560236b req-dc39c445-8ba3-4b8c-bb38-385c050077bc service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-deleted-09043b02-fceb-424b-9f68-a526293780c2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:08 user nova-compute[75293]: INFO nova.compute.manager [req-c6455254-c8f0-471e-82ae-7f700560236b req-dc39c445-8ba3-4b8c-bb38-385c050077bc service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Neutron deleted interface 09043b02-fceb-424b-9f68-a526293780c2; detaching it from the instance and deleting it from the info cache
Nov 30 07:10:08 user nova-compute[75293]: DEBUG nova.network.neutron [req-c6455254-c8f0-471e-82ae-7f700560236b req-dc39c445-8ba3-4b8c-bb38-385c050077bc service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updating instance_info_cache with network_info: [{"id": "60e4fab9-df41-42dd-be40-1300f77a7d89", "address": "fa:16:3e:01:72:2a", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e4fab9-df", "ovs_interfaceid": "60e4fab9-df41-42dd-be40-1300f77a7d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b998882b-1d11-404b-930e-91b355ded504", "address": "fa:16:3e:82:f1:9d", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb998882b-1d", "ovs_interfaceid": "b998882b-1d11-404b-930e-91b355ded504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b73c69b2-9f21-4615-80a4-7676df8071bd", "address": "fa:16:3e:28:00:25", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73c69b2-9f", "ovs_interfaceid": "b73c69b2-9f21-4615-80a4-7676df8071bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "address": "fa:16:3e:c2:fb:c4", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666a23fb-99", "ovs_interfaceid": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6563adbf-237c-4c69-a412-900192a28413]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:10:08 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-c6455254-c8f0-471e-82ae-7f700560236b req-dc39c445-8ba3-4b8c-bb38-385c050077bc service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Detach interface failed, port_id=09043b02-fceb-424b-9f68-a526293780c2, reason: Instance cc583d29-3df4-4406-b5a5-f4b3d300fabb could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-c6455254-c8f0-471e-82ae-7f700560236b req-dc39c445-8ba3-4b8c-bb38-385c050077bc service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-deleted-b73c69b2-9f21-4615-80a4-7676df8071bd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:08 user nova-compute[75293]: INFO nova.compute.manager [req-c6455254-c8f0-471e-82ae-7f700560236b req-dc39c445-8ba3-4b8c-bb38-385c050077bc service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Neutron deleted interface b73c69b2-9f21-4615-80a4-7676df8071bd; detaching it from the instance and deleting it from the info cache
Nov 30 07:10:08 user nova-compute[75293]: DEBUG nova.network.neutron [req-c6455254-c8f0-471e-82ae-7f700560236b req-dc39c445-8ba3-4b8c-bb38-385c050077bc service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updating instance_info_cache with network_info: [{"id": "60e4fab9-df41-42dd-be40-1300f77a7d89", "address": "fa:16:3e:01:72:2a", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e4fab9-df", "ovs_interfaceid": "60e4fab9-df41-42dd-be40-1300f77a7d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b998882b-1d11-404b-930e-91b355ded504", "address": "fa:16:3e:82:f1:9d", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb998882b-1d", "ovs_interfaceid": "b998882b-1d11-404b-930e-91b355ded504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "address": "fa:16:3e:c2:fb:c4", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666a23fb-99", "ovs_interfaceid": "666a23fb-99db-4762-9181-18e0fbbbfdf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:08 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Took 3.80 seconds to deallocate network for instance.
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9c4d00-37ae-4a92-bd77-14bb118fc803]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d] added
Nov 30 07:10:08 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-c6455254-c8f0-471e-82ae-7f700560236b req-dc39c445-8ba3-4b8c-bb38-385c050077bc service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Detach interface failed, port_id=b73c69b2-9f21-4615-80a4-7676df8071bd, reason: Instance cc583d29-3df4-4406-b5a5-f4b3d300fabb could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b83af1-f87e-42c1-9af1-3179a216e16f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ebad6f-f93f-4b0f-8d84-62f8a26d5cc5]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aZSPGysY {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aZSPGysY" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[84161928-8c90-46f3-a7fe-9cc10503eca0]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aZSPGysY'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb0492f-0ffa-4dc3-9e1c-b208b37ecc70]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c58d06-fd28-4183-8ff7-746b67a3ccb4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:10:08 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:10:08 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:08 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Deleted allocations for instance 09b63cd9-2f63-411d-886d-3ff237d145d0
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a8c6c1-2075-41d2-8b82-9a5662563bf2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d, portal: 172.16.0.220,3260]
Nov 30 07:10:08 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d, portal: 172.16.0.220,3260] successful.
Nov 30 07:10:08 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[346d36ed-5248-4a48-96cf-2e1b4c694646]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8980a3aa-0e47-4d0e-bfdb-d90071bfe6af]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:10:08 user nova-compute[75293]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:10:08 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:10:08 user nova-compute[75293]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:10:08 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-afb5c009-f7f5-40e2-b5c3-2dd2147f8dda tempest-TaggedBootDevicesTest-1519881645 tempest-TaggedBootDevicesTest-1519881645-project-member] Lock "09b63cd9-2f63-411d-886d-3ff237d145d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.548s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de749b5-957a-4160-abdb-3e78cef069f0]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:10:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZSPGysY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:10:09 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:10:09 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26137643766636537', 'path': '/dev/sdb'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:10:09 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137643766636537', 'path': '/dev/sdb'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:10:09 user nova-compute[75293]: DEBUG nova.objects.instance [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lazy-loading 'flavor' on Instance uuid 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:10:09 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:10:09 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:10:09 user nova-compute[75293]:   <source dev="/dev/sdb"/>
Nov 30 07:10:09 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:10:09 user nova-compute[75293]:   <serial>70c2fd19-a79e-4b40-8116-072dafa1a09d</serial>
Nov 30 07:10:09 user nova-compute[75293]: </disk>
Nov 30 07:10:09 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:10:09 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:10:09 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:10:09 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] No VIF found with MAC fa:16:3e:37:51:4d, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:10:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0352e9b0-ddad-4d5d-99f4-e499f7981ccf tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.419s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:10 user nova-compute[75293]: DEBUG nova.compute.manager [req-0b207be6-5ba7-459d-bd26-08cc78e89049 req-cbc0e0aa-96f0-4d6b-a86f-78d8ed2956bf service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Received event network-vif-deleted-666a23fb-99db-4762-9181-18e0fbbbfdf2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:10 user nova-compute[75293]: INFO nova.compute.manager [req-0b207be6-5ba7-459d-bd26-08cc78e89049 req-cbc0e0aa-96f0-4d6b-a86f-78d8ed2956bf service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Neutron deleted interface 666a23fb-99db-4762-9181-18e0fbbbfdf2; detaching it from the instance and deleting it from the info cache
Nov 30 07:10:10 user nova-compute[75293]: DEBUG nova.network.neutron [req-0b207be6-5ba7-459d-bd26-08cc78e89049 req-cbc0e0aa-96f0-4d6b-a86f-78d8ed2956bf service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Updating instance_info_cache with network_info: [{"id": "60e4fab9-df41-42dd-be40-1300f77a7d89", "address": "fa:16:3e:01:72:2a", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60e4fab9-df", "ovs_interfaceid": "60e4fab9-df41-42dd-be40-1300f77a7d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b998882b-1d11-404b-930e-91b355ded504", "address": "fa:16:3e:82:f1:9d", "network": {"id": "8a03fdb7-2f18-4db2-ad62-b75493779c0b", "bridge": "br-int", "label": "tempest-device-tagging-net1-678897174", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d0b4aec4e9794fa1bedce064018cc3a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb998882b-1d", "ovs_interfaceid": "b998882b-1d11-404b-930e-91b355ded504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:10 user nova-compute[75293]: DEBUG nova.compute.manager [req-0b207be6-5ba7-459d-bd26-08cc78e89049 req-cbc0e0aa-96f0-4d6b-a86f-78d8ed2956bf service nova] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Detach interface failed, port_id=666a23fb-99db-4762-9181-18e0fbbbfdf2, reason: Instance cc583d29-3df4-4406-b5a5-f4b3d300fabb could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:10:10 user nova-compute[75293]: INFO nova.compute.manager [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] [instance: cc583d29-3df4-4406-b5a5-f4b3d300fabb] Took 2.40 seconds to detach 3 volumes for instance.
Nov 30 07:10:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:10 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:10:10 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:10:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:11 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Deleted allocations for instance cc583d29-3df4-4406-b5a5-f4b3d300fabb
Nov 30 07:10:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7bbf62a1-1e40-41ae-ab20-57815a4c3c78 tempest-TaggedBootDevicesTest_v242-1204410285 tempest-TaggedBootDevicesTest_v242-1204410285-project-member] Lock "cc583d29-3df4-4406-b5a5-f4b3d300fabb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.132s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75293) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 07:10:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:10:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:10:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:16 user nova-compute[75293]: DEBUG nova.compute.manager [req-c3785926-e2f2-4ac6-a566-bf1b97e7eb04 req-8cf30cbc-a425-4c64-8eb0-fcbf6206ee31 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received event network-changed-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:16 user nova-compute[75293]: DEBUG nova.compute.manager [req-c3785926-e2f2-4ac6-a566-bf1b97e7eb04 req-8cf30cbc-a425-4c64-8eb0-fcbf6206ee31 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Refreshing instance network info cache due to event network-changed-fd8381e1-d2ff-4b1c-a6ed-704604abc20d. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:10:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c3785926-e2f2-4ac6-a566-bf1b97e7eb04 req-8cf30cbc-a425-4c64-8eb0-fcbf6206ee31 service nova] Acquiring lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:10:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c3785926-e2f2-4ac6-a566-bf1b97e7eb04 req-8cf30cbc-a425-4c64-8eb0-fcbf6206ee31 service nova] Acquired lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:10:16 user nova-compute[75293]: DEBUG nova.network.neutron [req-c3785926-e2f2-4ac6-a566-bf1b97e7eb04 req-8cf30cbc-a425-4c64-8eb0-fcbf6206ee31 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Refreshing network info cache for port fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:10:17 user nova-compute[75293]: DEBUG nova.network.neutron [req-c3785926-e2f2-4ac6-a566-bf1b97e7eb04 req-8cf30cbc-a425-4c64-8eb0-fcbf6206ee31 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Updated VIF entry in instance network info cache for port fd8381e1-d2ff-4b1c-a6ed-704604abc20d. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:10:17 user nova-compute[75293]: DEBUG nova.network.neutron [req-c3785926-e2f2-4ac6-a566-bf1b97e7eb04 req-8cf30cbc-a425-4c64-8eb0-fcbf6206ee31 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Updating instance_info_cache with network_info: [{"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c3785926-e2f2-4ac6-a566-bf1b97e7eb04 req-8cf30cbc-a425-4c64-8eb0-fcbf6206ee31 service nova] Releasing lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:10:17 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Waiting for libvirt event about the detach of device tape9034327-64 with device alias net1 from instance 67b8a66b-e7f8-41a1-8f5c-b29851ec608d is timed out.
Nov 30 07:10:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8c:13:37"/><model type="virtio"/><mtu size="1442"/><target dev="tape9034327-64"/></interface> {{(pid=75293) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 30 07:10:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8c:13:37"/><model type="virtio"/><mtu size="1442"/><target dev="tape9034327-64"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 30 07:10:17 user nova-compute[75293]:   <name>instance-00000007</name>
Nov 30 07:10:17 user nova-compute[75293]:   <uuid>67b8a66b-e7f8-41a1-8f5c-b29851ec608d</uuid>
Nov 30 07:10:17 user nova-compute[75293]:   <metadata>
Nov 30 07:10:17 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:10:17 user nova-compute[75293]:   <nova:package version="0.0.0"/>
Nov 30 07:10:17 user nova-compute[75293]:   <nova:name>tempest-device-tagging-server-448272992</nova:name>
Nov 30 07:10:17 user nova-compute[75293]:   <nova:creationTime>2023-11-30 07:09:18</nova:creationTime>
Nov 30 07:10:17 user nova-compute[75293]:   <nova:flavor name="m1.tiny">
Nov 30 07:10:17 user nova-compute[75293]:     <nova:memory>512</nova:memory>
Nov 30 07:10:17 user nova-compute[75293]:     <nova:disk>1</nova:disk>
Nov 30 07:10:17 user nova-compute[75293]:     <nova:swap>0</nova:swap>
Nov 30 07:10:17 user nova-compute[75293]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:10:17 user nova-compute[75293]:     <nova:vcpus>1</nova:vcpus>
Nov 30 07:10:17 user nova-compute[75293]:   </nova:flavor>
Nov 30 07:10:17 user nova-compute[75293]:   <nova:owner>
Nov 30 07:10:17 user nova-compute[75293]:     <nova:user uuid="d3af22daef9746c99424bf6581cc7608">tempest-TaggedAttachmentsTest-825521733-project-member</nova:user>
Nov 30 07:10:17 user nova-compute[75293]:     <nova:project uuid="67436111c10f475a9e2d249fe77f04c9">tempest-TaggedAttachmentsTest-825521733</nova:project>
Nov 30 07:10:17 user nova-compute[75293]:   </nova:owner>
Nov 30 07:10:17 user nova-compute[75293]:   <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:10:17 user nova-compute[75293]:   <nova:ports>
Nov 30 07:10:17 user nova-compute[75293]:     <nova:port uuid="4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e">
Nov 30 07:10:17 user nova-compute[75293]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 07:10:17 user nova-compute[75293]:     </nova:port>
Nov 30 07:10:17 user nova-compute[75293]:     <nova:port uuid="e9034327-6413-40df-842e-9ffbf58bb886">
Nov 30 07:10:17 user nova-compute[75293]:       <nova:ip type="fixed" address="10.10.10.52" ipVersion="4"/>
Nov 30 07:10:17 user nova-compute[75293]:     </nova:port>
Nov 30 07:10:17 user nova-compute[75293]:   </nova:ports>
Nov 30 07:10:17 user nova-compute[75293]: </nova:instance>
Nov 30 07:10:17 user nova-compute[75293]:   </metadata>
Nov 30 07:10:17 user nova-compute[75293]:   <memory unit='KiB'>524288</memory>
Nov 30 07:10:17 user nova-compute[75293]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 30 07:10:17 user nova-compute[75293]:   <vcpu placement='static'>1</vcpu>
Nov 30 07:10:17 user nova-compute[75293]:   <resource>
Nov 30 07:10:17 user nova-compute[75293]:     <partition>/machine</partition>
Nov 30 07:10:17 user nova-compute[75293]:   </resource>
Nov 30 07:10:17 user nova-compute[75293]:   <sysinfo type='smbios'>
Nov 30 07:10:17 user nova-compute[75293]:     <system>
Nov 30 07:10:17 user nova-compute[75293]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 30 07:10:17 user nova-compute[75293]:       <entry name='product'>OpenStack Nova</entry>
Nov 30 07:10:17 user nova-compute[75293]:       <entry name='version'>0.0.0</entry>
Nov 30 07:10:17 user nova-compute[75293]:       <entry name='serial'>67b8a66b-e7f8-41a1-8f5c-b29851ec608d</entry>
Nov 30 07:10:17 user nova-compute[75293]:       <entry name='uuid'>67b8a66b-e7f8-41a1-8f5c-b29851ec608d</entry>
Nov 30 07:10:17 user nova-compute[75293]:       <entry name='family'>Virtual Machine</entry>
Nov 30 07:10:17 user nova-compute[75293]:     </system>
Nov 30 07:10:17 user nova-compute[75293]:   </sysinfo>
Nov 30 07:10:17 user nova-compute[75293]:   <os>
Nov 30 07:10:17 user nova-compute[75293]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 30 07:10:17 user nova-compute[75293]:     <boot dev='hd'/>
Nov 30 07:10:17 user nova-compute[75293]:     <smbios mode='sysinfo'/>
Nov 30 07:10:17 user nova-compute[75293]:   </os>
Nov 30 07:10:17 user nova-compute[75293]:   <features>
Nov 30 07:10:17 user nova-compute[75293]:     <acpi/>
Nov 30 07:10:17 user nova-compute[75293]:     <apic/>
Nov 30 07:10:17 user nova-compute[75293]:     <vmcoreinfo state='on'/>
Nov 30 07:10:17 user nova-compute[75293]:   </features>
Nov 30 07:10:17 user nova-compute[75293]:   <cpu mode='custom' match='exact' check='full'>
Nov 30 07:10:17 user nova-compute[75293]:     <model fallback='forbid'>Nehalem</model>
Nov 30 07:10:17 user nova-compute[75293]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 30 07:10:17 user nova-compute[75293]:     <feature policy='require' name='vme'/>
Nov 30 07:10:17 user nova-compute[75293]:     <feature policy='require' name='x2apic'/>
Nov 30 07:10:17 user nova-compute[75293]:     <feature policy='require' name='hypervisor'/>
Nov 30 07:10:17 user nova-compute[75293]:   </cpu>
Nov 30 07:10:17 user nova-compute[75293]:   <clock offset='utc'>
Nov 30 07:10:17 user nova-compute[75293]:     <timer name='pit' tickpolicy='delay'/>
Nov 30 07:10:17 user nova-compute[75293]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 30 07:10:17 user nova-compute[75293]:     <timer name='hpet' present='no'/>
Nov 30 07:10:17 user nova-compute[75293]:   </clock>
Nov 30 07:10:17 user nova-compute[75293]:   <on_poweroff>destroy</on_poweroff>
Nov 30 07:10:17 user nova-compute[75293]:   <on_reboot>restart</on_reboot>
Nov 30 07:10:17 user nova-compute[75293]:   <on_crash>destroy</on_crash>
Nov 30 07:10:17 user nova-compute[75293]:   <devices>
Nov 30 07:10:17 user nova-compute[75293]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 30 07:10:17 user nova-compute[75293]:     <disk type='file' device='disk'>
Nov 30 07:10:17 user nova-compute[75293]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 30 07:10:17 user nova-compute[75293]:       <source file='/opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk' index='2'/>
Nov 30 07:10:17 user nova-compute[75293]:       <backingStore type='file' index='3'>
Nov 30 07:10:17 user nova-compute[75293]:         <format type='raw'/>
Nov 30 07:10:17 user nova-compute[75293]:         <source file='/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1'/>
Nov 30 07:10:17 user nova-compute[75293]:         <backingStore/>
Nov 30 07:10:17 user nova-compute[75293]:       </backingStore>
Nov 30 07:10:17 user nova-compute[75293]:       <target dev='vda' bus='virtio'/>
Nov 30 07:10:17 user nova-compute[75293]:       <alias name='virtio-disk0'/>
Nov 30 07:10:17 user nova-compute[75293]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 30 07:10:17 user nova-compute[75293]:     </disk>
Nov 30 07:10:17 user nova-compute[75293]:     <disk type='file' device='cdrom'>
Nov 30 07:10:17 user nova-compute[75293]:       <driver name='qemu' type='raw' cache='none'/>
Nov 30 07:10:17 user nova-compute[75293]:       <source file='/opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/disk.config' index='1'/>
Nov 30 07:10:17 user nova-compute[75293]:       <backingStore/>
Nov 30 07:10:17 user nova-compute[75293]:       <target dev='hda' bus='ide'/>
Nov 30 07:10:17 user nova-compute[75293]:       <readonly/>
Nov 30 07:10:17 user nova-compute[75293]:       <alias name='ide0-0-0'/>
Nov 30 07:10:17 user nova-compute[75293]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 30 07:10:17 user nova-compute[75293]:     </disk>
Nov 30 07:10:17 user nova-compute[75293]:     <controller type='usb' index='0' model='none'>
Nov 30 07:10:17 user nova-compute[75293]:       <alias name='usb'/>
Nov 30 07:10:17 user nova-compute[75293]:     </controller>
Nov 30 07:10:17 user nova-compute[75293]:     <controller type='pci' index='0' model='pci-root'>
Nov 30 07:10:17 user nova-compute[75293]:       <alias name='pci.0'/>
Nov 30 07:10:17 user nova-compute[75293]:     </controller>
Nov 30 07:10:17 user nova-compute[75293]:     <controller type='ide' index='0'>
Nov 30 07:10:17 user nova-compute[75293]:       <alias name='ide'/>
Nov 30 07:10:17 user nova-compute[75293]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 30 07:10:17 user nova-compute[75293]:     </controller>
Nov 30 07:10:17 user nova-compute[75293]:     <interface type='ethernet'>
Nov 30 07:10:17 user nova-compute[75293]:       <mac address='fa:16:3e:2b:05:2c'/>
Nov 30 07:10:17 user nova-compute[75293]:       <target dev='tap4079c1bd-9b'/>
Nov 30 07:10:17 user nova-compute[75293]:       <model type='virtio'/>
Nov 30 07:10:17 user nova-compute[75293]:       <mtu size='1442'/>
Nov 30 07:10:17 user nova-compute[75293]:       <alias name='net0'/>
Nov 30 07:10:17 user nova-compute[75293]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 30 07:10:17 user nova-compute[75293]:     </interface>
Nov 30 07:10:17 user nova-compute[75293]:     <serial type='pty'>
Nov 30 07:10:17 user nova-compute[75293]:       <source path='/dev/pts/6'/>
Nov 30 07:10:17 user nova-compute[75293]:       <log file='/opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/console.log' append='off'/>
Nov 30 07:10:17 user nova-compute[75293]:       <target type='isa-serial' port='0'>
Nov 30 07:10:17 user nova-compute[75293]:         <model name='isa-serial'/>
Nov 30 07:10:17 user nova-compute[75293]:       </target>
Nov 30 07:10:17 user nova-compute[75293]:       <alias name='serial0'/>
Nov 30 07:10:17 user nova-compute[75293]:     </serial>
Nov 30 07:10:17 user nova-compute[75293]:     <console type='pty' tty='/dev/pts/6'>
Nov 30 07:10:17 user nova-compute[75293]:       <source path='/dev/pts/6'/>
Nov 30 07:10:17 user nova-compute[75293]:       <log file='/opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d/console.log' append='off'/>
Nov 30 07:10:17 user nova-compute[75293]:       <target type='serial' port='0'/>
Nov 30 07:10:17 user nova-compute[75293]:       <alias name='serial0'/>
Nov 30 07:10:17 user nova-compute[75293]:     </console>
Nov 30 07:10:17 user nova-compute[75293]:     <input type='mouse' bus='ps2'>
Nov 30 07:10:17 user nova-compute[75293]:       <alias name='input0'/>
Nov 30 07:10:17 user nova-compute[75293]:     </input>
Nov 30 07:10:17 user nova-compute[75293]:     <input type='keyboard' bus='ps2'>
Nov 30 07:10:17 user nova-compute[75293]:       <alias name='input1'/>
Nov 30 07:10:17 user nova-compute[75293]:     </input>
Nov 30 07:10:17 user nova-compute[75293]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 30 07:10:17 user nova-compute[75293]:       <listen type='address' address='0.0.0.0'/>
Nov 30 07:10:17 user nova-compute[75293]:     </graphics>
Nov 30 07:10:17 user nova-compute[75293]:     <audio id='1' type='none'/>
Nov 30 07:10:17 user nova-compute[75293]:     <video>
Nov 30 07:10:17 user nova-compute[75293]:       <model type='virtio' heads='1' primary='yes'/>
Nov 30 07:10:17 user nova-compute[75293]:       <alias name='video0'/>
Nov 30 07:10:17 user nova-compute[75293]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 30 07:10:17 user nova-compute[75293]:     </video>
Nov 30 07:10:17 user nova-compute[75293]:     <memballoon model='virtio'>
Nov 30 07:10:17 user nova-compute[75293]:       <stats period='10'/>
Nov 30 07:10:17 user nova-compute[75293]:       <alias name='balloon0'/>
Nov 30 07:10:17 user nova-compute[75293]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 30 07:10:17 user nova-compute[75293]:     </memballoon>
Nov 30 07:10:17 user nova-compute[75293]:     <rng model='virtio'>
Nov 30 07:10:17 user nova-compute[75293]:       <backend model='random'>/dev/urandom</backend>
Nov 30 07:10:17 user nova-compute[75293]:       <alias name='rng0'/>
Nov 30 07:10:17 user nova-compute[75293]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 30 07:10:17 user nova-compute[75293]:     </rng>
Nov 30 07:10:17 user nova-compute[75293]:   </devices>
Nov 30 07:10:17 user nova-compute[75293]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 30 07:10:17 user nova-compute[75293]:     <label>libvirt-67b8a66b-e7f8-41a1-8f5c-b29851ec608d</label>
Nov 30 07:10:17 user nova-compute[75293]:     <imagelabel>libvirt-67b8a66b-e7f8-41a1-8f5c-b29851ec608d</imagelabel>
Nov 30 07:10:17 user nova-compute[75293]:   </seclabel>
Nov 30 07:10:17 user nova-compute[75293]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 30 07:10:17 user nova-compute[75293]:     <label>+64055:+108</label>
Nov 30 07:10:17 user nova-compute[75293]:     <imagelabel>+64055:+108</imagelabel>
Nov 30 07:10:17 user nova-compute[75293]:   </seclabel>
Nov 30 07:10:17 user nova-compute[75293]: </domain>
Nov 30 07:10:17 user nova-compute[75293]:  {{(pid=75293) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 30 07:10:17 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Successfully detached device tape9034327-64 from instance 67b8a66b-e7f8-41a1-8f5c-b29851ec608d from the live domain config.
Nov 30 07:10:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-448272992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-448272992',id=7,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjlAvbNSNxOu5edth1vYgsFbUXzkyrWPcRf1ffRD5CrTsh6WZzOo54MVbNVFLS5n8k7/BjeCIsOHkQu7rwF07QgVmeG30dScHl8rc2yZM/6i1oYAPea7ho5miPIPyzMag==',key_name='tempest-keypair-2066695250',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:07:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67436111c10f475a9e2d249fe77f04c9',ramdisk_id='',reservation_id='r-p1eo2eq9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-825521733',owner_user_name='tempest-TaggedAttachmentsTest-825521733-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:07:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3af22daef9746c99424bf6581cc7608',uuid=67b8a66b-e7f8-41a1-8f5c-b29851ec608d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9034327-6413-40df-842e-9ffbf58bb886", "address": "fa:16:3e:8c:13:37", "network": {"id": "b8c0f097-e9cb-4aa2-a925-da668439c435", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-656286509", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9034327-64", "ovs_interfaceid": "e9034327-6413-40df-842e-9ffbf58bb886", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:10:17 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Converting VIF {"id": "e9034327-6413-40df-842e-9ffbf58bb886", "address": "fa:16:3e:8c:13:37", "network": {"id": "b8c0f097-e9cb-4aa2-a925-da668439c435", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-656286509", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9034327-64", "ovs_interfaceid": "e9034327-6413-40df-842e-9ffbf58bb886", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:10:17 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:13:37,bridge_name='br-int',has_traffic_filtering=True,id=e9034327-6413-40df-842e-9ffbf58bb886,network=Network(b8c0f097-e9cb-4aa2-a925-da668439c435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9034327-64') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:10:17 user nova-compute[75293]: DEBUG os_vif [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:13:37,bridge_name='br-int',has_traffic_filtering=True,id=e9034327-6413-40df-842e-9ffbf58bb886,network=Network(b8c0f097-e9cb-4aa2-a925-da668439c435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9034327-64') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:10:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9034327-64, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=143dffe4-7d89-4df4-837a-3110982055c8) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:17 user nova-compute[75293]: INFO os_vif [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:13:37,bridge_name='br-int',has_traffic_filtering=True,id=e9034327-6413-40df-842e-9ffbf58bb886,network=Network(b8c0f097-e9cb-4aa2-a925-da668439c435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9034327-64')
Nov 30 07:10:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:10:17 user nova-compute[75293]:   <nova:package version="0.0.0"/>
Nov 30 07:10:17 user nova-compute[75293]:   <nova:name>tempest-device-tagging-server-448272992</nova:name>
Nov 30 07:10:17 user nova-compute[75293]:   <nova:creationTime>2023-11-30 07:10:17</nova:creationTime>
Nov 30 07:10:17 user nova-compute[75293]:   <nova:flavor name="m1.tiny">
Nov 30 07:10:17 user nova-compute[75293]:     <nova:memory>512</nova:memory>
Nov 30 07:10:17 user nova-compute[75293]:     <nova:disk>1</nova:disk>
Nov 30 07:10:17 user nova-compute[75293]:     <nova:swap>0</nova:swap>
Nov 30 07:10:17 user nova-compute[75293]:     <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:10:17 user nova-compute[75293]:     <nova:vcpus>1</nova:vcpus>
Nov 30 07:10:17 user nova-compute[75293]:   </nova:flavor>
Nov 30 07:10:17 user nova-compute[75293]:   <nova:owner>
Nov 30 07:10:17 user nova-compute[75293]:     <nova:user uuid="d3af22daef9746c99424bf6581cc7608">tempest-TaggedAttachmentsTest-825521733-project-member</nova:user>
Nov 30 07:10:17 user nova-compute[75293]:     <nova:project uuid="67436111c10f475a9e2d249fe77f04c9">tempest-TaggedAttachmentsTest-825521733</nova:project>
Nov 30 07:10:17 user nova-compute[75293]:   </nova:owner>
Nov 30 07:10:17 user nova-compute[75293]:   <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:10:17 user nova-compute[75293]:   <nova:ports>
Nov 30 07:10:17 user nova-compute[75293]:     <nova:port uuid="4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e">
Nov 30 07:10:17 user nova-compute[75293]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 07:10:17 user nova-compute[75293]:     </nova:port>
Nov 30 07:10:17 user nova-compute[75293]:   </nova:ports>
Nov 30 07:10:17 user nova-compute[75293]: </nova:instance>
Nov 30 07:10:17 user nova-compute[75293]:  {{(pid=75293) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 30 07:10:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquiring lock "refresh_cache-67b8a66b-e7f8-41a1-8f5c-b29851ec608d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:10:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquired lock "refresh_cache-67b8a66b-e7f8-41a1-8f5c-b29851ec608d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:10:17 user nova-compute[75293]: DEBUG nova.network.neutron [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:10:18 user nova-compute[75293]: INFO nova.network.neutron [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Port e9034327-6413-40df-842e-9ffbf58bb886 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 30 07:10:18 user nova-compute[75293]: DEBUG nova.network.neutron [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Updating instance_info_cache with network_info: [{"id": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "address": "fa:16:3e:2b:05:2c", "network": {"id": "ebc5494d-4e41-410c-a9ef-96a92a44d1d2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1004206243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4079c1bd-9b", "ovs_interfaceid": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Releasing lock "refresh_cache-67b8a66b-e7f8-41a1-8f5c-b29851ec608d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:10:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-03dc2834-f294-4b52-a144-464143659559 tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "interface-67b8a66b-e7f8-41a1-8f5c-b29851ec608d-e9034327-6413-40df-842e-9ffbf58bb886" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.380s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:18 user nova-compute[75293]: DEBUG nova.compute.manager [req-d4681c2a-ef0d-4dcb-828c-a8602de242fe req-9036257b-1bf4-4eb5-b7bf-9168668ab531 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received event network-vif-deleted-e9034327-6413-40df-842e-9ffbf58bb886 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:18 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dcd1ca28-3784-45b3-a3d3-e3231d8e82bb is timed out.
Nov 30 07:10:18 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Successfully detached device vdb from instance dcd1ca28-3784-45b3-a3d3-e3231d8e82bb from the live domain config.
Nov 30 07:10:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:10:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZzqkOjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '3a07d874-8250-4118-823e-acc286caf324'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:10:18 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:10:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:10:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:10:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad7c262-be94-4f5a-bfe5-67fc15d3b52d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:10:19 user nova-compute[75293]: No targets found.
Nov 30 07:10:19 user nova-compute[75293]: iSNS:
Nov 30 07:10:19 user nova-compute[75293]: No targets found.
Nov 30 07:10:19 user nova-compute[75293]: STATIC:
Nov 30 07:10:19 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d
Nov 30 07:10:19 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:19 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:19 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324
Nov 30 07:10:19 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:19 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:19 user nova-compute[75293]: FIRMWARE:
Nov 30 07:10:19 user nova-compute[75293]: No targets found.
Nov 30 07:10:19 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:10:19 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:10:19 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fda38d-625d-43ab-a026-5a6a931cceba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21802cf-29d7-483a-852e-83338d17e231]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:10:19 user nova-compute[75293]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:10:19 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 (non-flash)
Nov 30 07:10:19 user nova-compute[75293]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:10:19 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effc87bd630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324'): ({'sdh'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Removing single pathed devices sdh {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d56aa1f-eae1-45c6-898c-dec317b36cb3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2464370-11a9-41b9-a06c-386e313b799a]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Flushing IO for device /dev/sdh {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d444cc8-937d-44bb-8fe2-f7a80bf334d2]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8364ab2a-bbd9-4312-a38e-c803e4ca4b82]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] SCSI volumes sdh have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab4622b-797b-4b48-9e85-7b8060a563b4]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fadd0fa-ce32-45fe-9f22-8fff8a821559]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324, portal: 172.16.0.220,3260]
Nov 30 07:10:19 user nova-compute[75293]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324, portal: 172.16.0.220,3260] successful.
Nov 30 07:10:19 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a07d874-8250-4118-823e-acc286caf324 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0786e435-89ff-4064-8db3-02ba55d27993]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] <== disconnect_volume: return (270ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG nova.compute.manager [req-9e6d44ea-ea70-4493-ae05-5fd5da0b2b58 req-151919f6-f660-41fe-a742-3a9dca6575f1 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received event network-changed-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG nova.compute.manager [req-9e6d44ea-ea70-4493-ae05-5fd5da0b2b58 req-151919f6-f660-41fe-a742-3a9dca6575f1 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Refreshing instance network info cache due to event network-changed-fd8381e1-d2ff-4b1c-a6ed-704604abc20d. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9e6d44ea-ea70-4493-ae05-5fd5da0b2b58 req-151919f6-f660-41fe-a742-3a9dca6575f1 service nova] Acquiring lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9e6d44ea-ea70-4493-ae05-5fd5da0b2b58 req-151919f6-f660-41fe-a742-3a9dca6575f1 service nova] Acquired lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG nova.network.neutron [req-9e6d44ea-ea70-4493-ae05-5fd5da0b2b58 req-151919f6-f660-41fe-a742-3a9dca6575f1 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Refreshing network info cache for port fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG nova.network.neutron [req-9e6d44ea-ea70-4493-ae05-5fd5da0b2b58 req-151919f6-f660-41fe-a742-3a9dca6575f1 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Updated VIF entry in instance network info cache for port fd8381e1-d2ff-4b1c-a6ed-704604abc20d. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG nova.network.neutron [req-9e6d44ea-ea70-4493-ae05-5fd5da0b2b58 req-151919f6-f660-41fe-a742-3a9dca6575f1 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Updating instance_info_cache with network_info: [{"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9e6d44ea-ea70-4493-ae05-5fd5da0b2b58 req-151919f6-f660-41fe-a742-3a9dca6575f1 service nova] Releasing lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:10:20 user nova-compute[75293]: DEBUG nova.objects.instance [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lazy-loading 'flavor' on Instance uuid dcd1ca28-3784-45b3-a3d3-e3231d8e82bb {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:10:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-583051c0-146f-42f2-bb24-473469bc0071 tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.752s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "5c5d7382-107c-49af-bdc5-3600ab6425e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "5c5d7382-107c-49af-bdc5-3600ab6425e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG nova.compute.manager [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:10:21 user nova-compute[75293]: INFO nova.compute.claims [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Claim successful on node user
Nov 30 07:10:21 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG nova.compute.manager [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG nova.compute.manager [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG nova.network.neutron [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:10:21 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:10:21 user nova-compute[75293]: DEBUG nova.compute.manager [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG nova.policy [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a489452874654d99ba7f7b68eb62d30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba486b18243b4462a2a4c35b6c478a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG nova.compute.manager [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:10:21 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Creating image(s)
Nov 30 07:10:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "/opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "/opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.199s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.207s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/disk 1073741824" returned: 0 in 0.064s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG nova.network.neutron [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Successfully created port: 6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.171s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Cannot resize image /opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Ensure instance console log exists: /opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG nova.network.neutron [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Successfully updated port: 6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "refresh_cache-5c5d7382-107c-49af-bdc5-3600ab6425e8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquired lock "refresh_cache-5c5d7382-107c-49af-bdc5-3600ab6425e8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG nova.network.neutron [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG nova.compute.manager [req-b4599de7-24d9-42b5-9da0-767160751a8a req-745b9508-591e-4197-a45e-79eddc540581 service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Received event network-changed-6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG nova.compute.manager [req-b4599de7-24d9-42b5-9da0-767160751a8a req-745b9508-591e-4197-a45e-79eddc540581 service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Refreshing instance network info cache due to event network-changed-6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b4599de7-24d9-42b5-9da0-767160751a8a req-745b9508-591e-4197-a45e-79eddc540581 service nova] Acquiring lock "refresh_cache-5c5d7382-107c-49af-bdc5-3600ab6425e8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:10:22 user nova-compute[75293]: DEBUG nova.network.neutron [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.network.neutron [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Updating instance_info_cache with network_info: [{"id": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "address": "fa:16:3e:b4:a2:f0", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6106eeb2-5f", "ovs_interfaceid": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Releasing lock "refresh_cache-5c5d7382-107c-49af-bdc5-3600ab6425e8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.compute.manager [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Instance network_info: |[{"id": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "address": "fa:16:3e:b4:a2:f0", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6106eeb2-5f", "ovs_interfaceid": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b4599de7-24d9-42b5-9da0-767160751a8a req-745b9508-591e-4197-a45e-79eddc540581 service nova] Acquired lock "refresh_cache-5c5d7382-107c-49af-bdc5-3600ab6425e8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.network.neutron [req-b4599de7-24d9-42b5-9da0-767160751a8a req-745b9508-591e-4197-a45e-79eddc540581 service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Refreshing network info cache for port 6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Start _get_guest_xml network_info=[{"id": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "address": "fa:16:3e:b4:a2:f0", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6106eeb2-5f", "ovs_interfaceid": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:10:23 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:10:23 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:10:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1414652166',display_name='tempest-VolumesAdminNegativeTest-server-1414652166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1414652166',id=13,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba486b18243b4462a2a4c35b6c478a0a',ramdisk_id='',reservation_id='r-a36pdxmx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1001198017',owner_user_name='tempest-VolumesAdminNegativeTest-1001198017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:10:22Z,user_data=None,user_id='a489452874654d99ba7f7b68eb62d30b',uuid=5c5d7382-107c-49af-bdc5-3600ab6425e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "address": "fa:16:3e:b4:a2:f0", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6106eeb2-5f", "ovs_interfaceid": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Converting VIF {"id": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "address": "fa:16:3e:b4:a2:f0", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6106eeb2-5f", "ovs_interfaceid": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:a2:f0,bridge_name='br-int',has_traffic_filtering=True,id=6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5,network=Network(43e6a947-eef6-4e52-afaf-c2defb3200b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6106eeb2-5f') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.objects.instance [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c5d7382-107c-49af-bdc5-3600ab6425e8 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:10:23 user nova-compute[75293]:   <uuid>5c5d7382-107c-49af-bdc5-3600ab6425e8</uuid>
Nov 30 07:10:23 user nova-compute[75293]:   <name>instance-0000000d</name>
Nov 30 07:10:23 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:10:23 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:10:23 user nova-compute[75293]:   <metadata>
Nov 30 07:10:23 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:10:23 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:10:23 user nova-compute[75293]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1414652166</nova:name>
Nov 30 07:10:23 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:10:23</nova:creationTime>
Nov 30 07:10:23 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:10:23 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:10:23 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:10:23 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:10:23 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:10:23 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:10:23 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:10:23 user nova-compute[75293]:       <nova:owner>
Nov 30 07:10:23 user nova-compute[75293]:         <nova:user uuid="a489452874654d99ba7f7b68eb62d30b">tempest-VolumesAdminNegativeTest-1001198017-project-member</nova:user>
Nov 30 07:10:23 user nova-compute[75293]:         <nova:project uuid="ba486b18243b4462a2a4c35b6c478a0a">tempest-VolumesAdminNegativeTest-1001198017</nova:project>
Nov 30 07:10:23 user nova-compute[75293]:       </nova:owner>
Nov 30 07:10:23 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:10:23 user nova-compute[75293]:       <nova:ports>
Nov 30 07:10:23 user nova-compute[75293]:         <nova:port uuid="6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5">
Nov 30 07:10:23 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 07:10:23 user nova-compute[75293]:         </nova:port>
Nov 30 07:10:23 user nova-compute[75293]:       </nova:ports>
Nov 30 07:10:23 user nova-compute[75293]:     </nova:instance>
Nov 30 07:10:23 user nova-compute[75293]:   </metadata>
Nov 30 07:10:23 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:10:23 user nova-compute[75293]:     <system>
Nov 30 07:10:23 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:10:23 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:10:23 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:10:23 user nova-compute[75293]:       <entry name="serial">5c5d7382-107c-49af-bdc5-3600ab6425e8</entry>
Nov 30 07:10:23 user nova-compute[75293]:       <entry name="uuid">5c5d7382-107c-49af-bdc5-3600ab6425e8</entry>
Nov 30 07:10:23 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:10:23 user nova-compute[75293]:     </system>
Nov 30 07:10:23 user nova-compute[75293]:   </sysinfo>
Nov 30 07:10:23 user nova-compute[75293]:   <os>
Nov 30 07:10:23 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:10:23 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:10:23 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:10:23 user nova-compute[75293]:   </os>
Nov 30 07:10:23 user nova-compute[75293]:   <features>
Nov 30 07:10:23 user nova-compute[75293]:     <acpi/>
Nov 30 07:10:23 user nova-compute[75293]:     <apic/>
Nov 30 07:10:23 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:10:23 user nova-compute[75293]:   </features>
Nov 30 07:10:23 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:10:23 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:10:23 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:10:23 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:10:23 user nova-compute[75293]:   </clock>
Nov 30 07:10:23 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:10:23 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:10:23 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:10:23 user nova-compute[75293]:   </cpu>
Nov 30 07:10:23 user nova-compute[75293]:   <devices>
Nov 30 07:10:23 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:10:23 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:10:23 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/disk"/>
Nov 30 07:10:23 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:10:23 user nova-compute[75293]:     </disk>
Nov 30 07:10:23 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:10:23 user nova-compute[75293]:       <mac address="fa:16:3e:b4:a2:f0"/>
Nov 30 07:10:23 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:10:23 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:10:23 user nova-compute[75293]:       <target dev="tap6106eeb2-5f"/>
Nov 30 07:10:23 user nova-compute[75293]:     </interface>
Nov 30 07:10:23 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:10:23 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/console.log" append="off"/>
Nov 30 07:10:23 user nova-compute[75293]:     </serial>
Nov 30 07:10:23 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:10:23 user nova-compute[75293]:     <video>
Nov 30 07:10:23 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:10:23 user nova-compute[75293]:     </video>
Nov 30 07:10:23 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:10:23 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:10:23 user nova-compute[75293]:     </rng>
Nov 30 07:10:23 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:10:23 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:10:23 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:10:23 user nova-compute[75293]:     </memballoon>
Nov 30 07:10:23 user nova-compute[75293]:   </devices>
Nov 30 07:10:23 user nova-compute[75293]: </domain>
Nov 30 07:10:23 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:10:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1414652166',display_name='tempest-VolumesAdminNegativeTest-server-1414652166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1414652166',id=13,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba486b18243b4462a2a4c35b6c478a0a',ramdisk_id='',reservation_id='r-a36pdxmx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1001198017',owner_user_name='tempest-VolumesAdminNegativeTest-1001198017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:10:22Z,user_data=None,user_id='a489452874654d99ba7f7b68eb62d30b',uuid=5c5d7382-107c-49af-bdc5-3600ab6425e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "address": "fa:16:3e:b4:a2:f0", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6106eeb2-5f", "ovs_interfaceid": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Converting VIF {"id": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "address": "fa:16:3e:b4:a2:f0", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6106eeb2-5f", "ovs_interfaceid": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:a2:f0,bridge_name='br-int',has_traffic_filtering=True,id=6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5,network=Network(43e6a947-eef6-4e52-afaf-c2defb3200b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6106eeb2-5f') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG os_vif [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:a2:f0,bridge_name='br-int',has_traffic_filtering=True,id=6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5,network=Network(43e6a947-eef6-4e52-afaf-c2defb3200b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6106eeb2-5f') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ead23d7-06f2-5d00-84ef-872cbf9aa211', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6106eeb2-5f, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6106eeb2-5f, col_values=(('qos', UUID('e679b41b-33fb-45c0-a3d1-c057e1517a18')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6106eeb2-5f, col_values=(('external_ids', {'iface-id': '6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:a2:f0', 'vm-uuid': '5c5d7382-107c-49af-bdc5-3600ab6425e8'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:23 user nova-compute[75293]: INFO os_vif [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:a2:f0,bridge_name='br-int',has_traffic_filtering=True,id=6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5,network=Network(43e6a947-eef6-4e52-afaf-c2defb3200b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6106eeb2-5f')
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] No VIF found with MAC fa:16:3e:b4:a2:f0, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.network.neutron [req-b4599de7-24d9-42b5-9da0-767160751a8a req-745b9508-591e-4197-a45e-79eddc540581 service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Updated VIF entry in instance network info cache for port 6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG nova.network.neutron [req-b4599de7-24d9-42b5-9da0-767160751a8a req-745b9508-591e-4197-a45e-79eddc540581 service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Updating instance_info_cache with network_info: [{"id": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "address": "fa:16:3e:b4:a2:f0", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6106eeb2-5f", "ovs_interfaceid": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b4599de7-24d9-42b5-9da0-767160751a8a req-745b9508-591e-4197-a45e-79eddc540581 service nova] Releasing lock "refresh_cache-5c5d7382-107c-49af-bdc5-3600ab6425e8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:10:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:24 user nova-compute[75293]: INFO nova.compute.manager [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Rebooting instance
Nov 30 07:10:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:10:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquired lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:10:24 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:10:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:24 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Updating instance_info_cache with network_info: [{"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Releasing lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:10:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:24 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:10:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG nova.compute.manager [req-cbb87b3a-ad8a-4ca4-8c78-81a49fab350d req-b348f4de-4d3c-424b-8481-5054330e2fb2 service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Received event network-vif-plugged-6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cbb87b3a-ad8a-4ca4-8c78-81a49fab350d req-b348f4de-4d3c-424b-8481-5054330e2fb2 service nova] Acquiring lock "5c5d7382-107c-49af-bdc5-3600ab6425e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cbb87b3a-ad8a-4ca4-8c78-81a49fab350d req-b348f4de-4d3c-424b-8481-5054330e2fb2 service nova] Lock "5c5d7382-107c-49af-bdc5-3600ab6425e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cbb87b3a-ad8a-4ca4-8c78-81a49fab350d req-b348f4de-4d3c-424b-8481-5054330e2fb2 service nova] Lock "5c5d7382-107c-49af-bdc5-3600ab6425e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG nova.compute.manager [req-cbb87b3a-ad8a-4ca4-8c78-81a49fab350d req-b348f4de-4d3c-424b-8481-5054330e2fb2 service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] No waiting events found dispatching network-vif-plugged-6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:25 user nova-compute[75293]: WARNING nova.compute.manager [req-cbb87b3a-ad8a-4ca4-8c78-81a49fab350d req-b348f4de-4d3c-424b-8481-5054330e2fb2 service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Received unexpected event network-vif-plugged-6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5 for instance with vm_state building and task_state spawning.
Nov 30 07:10:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG nova.compute.manager [req-2bc731f7-5853-4655-b70b-125f3a4e4faf req-9f4db1b7-1043-4289-9aaf-9a5dbe928e91 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received event network-vif-unplugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2bc731f7-5853-4655-b70b-125f3a4e4faf req-9f4db1b7-1043-4289-9aaf-9a5dbe928e91 service nova] Acquiring lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2bc731f7-5853-4655-b70b-125f3a4e4faf req-9f4db1b7-1043-4289-9aaf-9a5dbe928e91 service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2bc731f7-5853-4655-b70b-125f3a4e4faf req-9f4db1b7-1043-4289-9aaf-9a5dbe928e91 service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG nova.compute.manager [req-2bc731f7-5853-4655-b70b-125f3a4e4faf req-9f4db1b7-1043-4289-9aaf-9a5dbe928e91 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] No waiting events found dispatching network-vif-unplugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:25 user nova-compute[75293]: WARNING nova.compute.manager [req-2bc731f7-5853-4655-b70b-125f3a4e4faf req-9f4db1b7-1043-4289-9aaf-9a5dbe928e91 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received unexpected event network-vif-unplugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d for instance with vm_state active and task_state reboot_started_hard.
Nov 30 07:10:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:25 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Instance destroyed successfully.
Nov 30 07:10:25 user nova-compute[75293]: DEBUG nova.objects.instance [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lazy-loading 'resources' on Instance uuid 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:08:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1186982627',display_name='tempest-TestMinimumBasicScenario-server-1186982627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1186982627',id=10,image_ref='a1bf2a8e-e3eb-4347-ab61-743834e154b1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMsqMmo5y5nrEe5/EAysBz/TZmoUguWfKbQBA8gdmeoccDDnOAjy5UCqnVUy3WWOjscjA4KGhVhWlQXcLk+3JBDwSAjPrQ2phWWgCzGRSuo5bA6deESyxfSvJVRmTiGJw==',key_name='tempest-TestMinimumBasicScenario-1562981580',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:08:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='995a27035c0c4b59b4bc11ef5ed479e7',ramdisk_id='',reservation_id='r-bz3g0w69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a1bf2a8e-e3eb-4347-ab61-743834e154b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1736397132',owner_user_name='tempest-TestMinimumBasicScenario-1736397132-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:10:25Z,user_data=None,user_id='6c37e36f7b5c4dfe815886140d24ea26',uuid=1d2d8481-7c11-42dd-b60f-0129aa3d3ec8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Converting VIF {"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:51:4d,bridge_name='br-int',has_traffic_filtering=True,id=fd8381e1-d2ff-4b1c-a6ed-704604abc20d,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd8381e1-d2') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG os_vif [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:51:4d,bridge_name='br-int',has_traffic_filtering=True,id=fd8381e1-d2ff-4b1c-a6ed-704604abc20d,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd8381e1-d2') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd8381e1-d2, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b24baa2-26ba-4b23-adf4-f2547358d894) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:25 user nova-compute[75293]: INFO os_vif [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:51:4d,bridge_name='br-int',has_traffic_filtering=True,id=fd8381e1-d2ff-4b1c-a6ed-704604abc20d,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd8381e1-d2')
Nov 30 07:10:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZSPGysY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:10:25 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:10:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f615caa-d579-4828-b8d8-a8a2f432aa59]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:10:25 user nova-compute[75293]: No targets found.
Nov 30 07:10:25 user nova-compute[75293]: iSNS:
Nov 30 07:10:25 user nova-compute[75293]: No targets found.
Nov 30 07:10:25 user nova-compute[75293]: STATIC:
Nov 30 07:10:25 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d
Nov 30 07:10:25 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:10:25 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:10:25 user nova-compute[75293]: FIRMWARE:
Nov 30 07:10:25 user nova-compute[75293]: No targets found.
Nov 30 07:10:25 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:10:25 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:10:25 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:10:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68a63d5-48e8-44a4-b88b-61b5bf064c69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c9ee1e-5b3d-41f9-b456-f6ab80b7428f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:10:26 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:10:26 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe83d6b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d'): ({'sdb'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Removing single pathed devices sdb {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb2d385-90bb-4fa0-94a0-e83baf6c5dca]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8d2c83-c806-4b0d-bef5-492777a30fcd]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Flushing IO for device /dev/sdb {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[64405a37-53b3-4c85-8be1-4f37369f474e]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.091s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ee7e42-6a70-4ee8-9b80-54a33b5cb9ac]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec61a49-5eee-4c66-83f5-ceb370537ee4]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea2bbe2-fc0a-4b8d-b104-6be07488c707]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d, portal: 172.16.0.220,3260]
Nov 30 07:10:26 user nova-compute[75293]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d, portal: 172.16.0.220,3260] successful.
Nov 30 07:10:26 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[478274ed-6f4d-4501-9049-9056b3571c4e]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.424s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] <== disconnect_volume: return (426ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Start _get_guest_xml network_info=[{"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a1bf2a8e-e3eb-4347-ab61-743834e154b1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a1bf2a8e-e3eb-4347-ab61-743834e154b1'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZSPGysY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1d2d8481-7c11-42dd-b60f-0129aa3d3ec8', 'attached_at': '', 'detached_at': '', 'volume_id': '70c2fd19-a79e-4b40-8116-072dafa1a09d', 'serial': '70c2fd19-a79e-4b40-8116-072dafa1a09d'}, 'delete_on_termination': False, 'attachment_id': '04006d54-1e92-43ec-91aa-b432cc3b19e3', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:10:26 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:10:26 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a1bf2a8e-e3eb-4347-ab61-743834e154b1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.objects.instance [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.objects.base [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Object Instance<1d2d8481-7c11-42dd-b60f-0129aa3d3ec8> lazy-loaded attributes: resources,vcpu_model {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZSPGysY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:10:26 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:10:26 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:10:26 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:10:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab116f8-3240-4bca-a7f2-db4cc5d9ea7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:10:26 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc22e5b-7d6b-4743-a344-333f54b317d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d] added
Nov 30 07:10:26 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[27486cff-d8bf-4bfc-9666-620575175e61]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[800825d2-cdfc-4a3d-aade-cdb263a5c2c2]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aZSPGysY {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aZSPGysY" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88dbb2e-6f0e-4e64-8382-97e075e856f9]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aZSPGysY'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9728772e-7f27-4b59-93de-61df8ff7da59]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccf9b25-2594-43fb-866f-dcff0a12050d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 07:10:26 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 07:10:26 user nova-compute[75293]:  {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:10:26 user nova-compute[75293]: WARNING os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 07:10:26 user nova-compute[75293]: 
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0f8bfd-0b5e-41b7-b8fd-34d865fb3310]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d, portal: 172.16.0.220,3260]
Nov 30 07:10:26 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d, portal: 172.16.0.220,3260] successful.
Nov 30 07:10:26 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2e2761-e2d9-4c9b-9bca-e756463c6d2a]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[912667d8-2f61-48d0-820a-62b07263315e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:10:26 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:10:26 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7a4858-23a0-405b-963c-57f2278f2eb6]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:10:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZSPGysY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.compute.manager [req-c8585f72-c833-4260-af1e-dfd57f4bcb77 req-d9c72b1f-8048-419f-8769-0dabf12d5324 service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Received event network-vif-plugged-6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c8585f72-c833-4260-af1e-dfd57f4bcb77 req-d9c72b1f-8048-419f-8769-0dabf12d5324 service nova] Acquiring lock "5c5d7382-107c-49af-bdc5-3600ab6425e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c8585f72-c833-4260-af1e-dfd57f4bcb77 req-d9c72b1f-8048-419f-8769-0dabf12d5324 service nova] Lock "5c5d7382-107c-49af-bdc5-3600ab6425e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c8585f72-c833-4260-af1e-dfd57f4bcb77 req-d9c72b1f-8048-419f-8769-0dabf12d5324 service nova] Lock "5c5d7382-107c-49af-bdc5-3600ab6425e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.compute.manager [req-c8585f72-c833-4260-af1e-dfd57f4bcb77 req-d9c72b1f-8048-419f-8769-0dabf12d5324 service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] No waiting events found dispatching network-vif-plugged-6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:27 user nova-compute[75293]: WARNING nova.compute.manager [req-c8585f72-c833-4260-af1e-dfd57f4bcb77 req-d9c72b1f-8048-419f-8769-0dabf12d5324 service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Received unexpected event network-vif-plugged-6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5 for instance with vm_state building and task_state spawning.
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:10:27 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Instance spawned successfully.
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:10:27 user nova-compute[75293]: INFO nova.compute.manager [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.compute.manager [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received event network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] Acquiring lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.compute.manager [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] No waiting events found dispatching network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:27 user nova-compute[75293]: WARNING nova.compute.manager [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received unexpected event network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d for instance with vm_state active and task_state reboot_started_hard.
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.compute.manager [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received event network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] Acquiring lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.compute.manager [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] No waiting events found dispatching network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:27 user nova-compute[75293]: WARNING nova.compute.manager [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received unexpected event network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d for instance with vm_state active and task_state reboot_started_hard.
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.compute.manager [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received event network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] Acquiring lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.compute.manager [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] No waiting events found dispatching network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:27 user nova-compute[75293]: WARNING nova.compute.manager [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received unexpected event network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d for instance with vm_state active and task_state reboot_started_hard.
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.compute.manager [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received event network-vif-unplugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] Acquiring lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.compute.manager [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] No waiting events found dispatching network-vif-unplugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:27 user nova-compute[75293]: WARNING nova.compute.manager [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received unexpected event network-vif-unplugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d for instance with vm_state active and task_state reboot_started_hard.
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.compute.manager [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received event network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] Acquiring lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.compute.manager [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] No waiting events found dispatching network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:27 user nova-compute[75293]: WARNING nova.compute.manager [req-50205b42-71a1-47f3-8f90-2764ba49e5f8 req-300e153c-601a-4bd7-9893-7e7d5e9ebc0b service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received unexpected event network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d for instance with vm_state active and task_state reboot_started_hard.
Nov 30 07:10:27 user nova-compute[75293]: INFO nova.compute.manager [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Took 6.57 seconds to build instance.
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-366329cf-3859-4296-a3d9-5013c4ae62fc tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "5c5d7382-107c-49af-bdc5-3600ab6425e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.661s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26137643766636537', 'path': '/dev/sdb'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137643766636537', 'path': '/dev/sdb'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:08:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1186982627',display_name='tempest-TestMinimumBasicScenario-server-1186982627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1186982627',id=10,image_ref='a1bf2a8e-e3eb-4347-ab61-743834e154b1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMsqMmo5y5nrEe5/EAysBz/TZmoUguWfKbQBA8gdmeoccDDnOAjy5UCqnVUy3WWOjscjA4KGhVhWlQXcLk+3JBDwSAjPrQ2phWWgCzGRSuo5bA6deESyxfSvJVRmTiGJw==',key_name='tempest-TestMinimumBasicScenario-1562981580',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:08:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='995a27035c0c4b59b4bc11ef5ed479e7',ramdisk_id='',reservation_id='r-bz3g0w69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a1bf2a8e-e3eb-4347-ab61-743834e154b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1736397132',owner_user_name='tempest-TestMinimumBasicScenario-1736397132-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:10:25Z,user_data=None,user_id='6c37e36f7b5c4dfe815886140d24ea26',uuid=1d2d8481-7c11-42dd-b60f-0129aa3d3ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Converting VIF {"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:51:4d,bridge_name='br-int',has_traffic_filtering=True,id=fd8381e1-d2ff-4b1c-a6ed-704604abc20d,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd8381e1-d2') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.objects.instance [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.objects.base [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Object Instance<1d2d8481-7c11-42dd-b60f-0129aa3d3ec8> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:10:27 user nova-compute[75293]:   <uuid>1d2d8481-7c11-42dd-b60f-0129aa3d3ec8</uuid>
Nov 30 07:10:27 user nova-compute[75293]:   <name>instance-0000000a</name>
Nov 30 07:10:27 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:10:27 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:10:27 user nova-compute[75293]:   <metadata>
Nov 30 07:10:27 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:10:27 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:10:27 user nova-compute[75293]:       <nova:name>tempest-TestMinimumBasicScenario-server-1186982627</nova:name>
Nov 30 07:10:27 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:10:26</nova:creationTime>
Nov 30 07:10:27 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:10:27 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:10:27 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:10:27 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:10:27 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:10:27 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:10:27 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:10:27 user nova-compute[75293]:       <nova:owner>
Nov 30 07:10:27 user nova-compute[75293]:         <nova:user uuid="6c37e36f7b5c4dfe815886140d24ea26">tempest-TestMinimumBasicScenario-1736397132-project-member</nova:user>
Nov 30 07:10:27 user nova-compute[75293]:         <nova:project uuid="995a27035c0c4b59b4bc11ef5ed479e7">tempest-TestMinimumBasicScenario-1736397132</nova:project>
Nov 30 07:10:27 user nova-compute[75293]:       </nova:owner>
Nov 30 07:10:27 user nova-compute[75293]:       <nova:root type="image" uuid="a1bf2a8e-e3eb-4347-ab61-743834e154b1"/>
Nov 30 07:10:27 user nova-compute[75293]:       <nova:ports>
Nov 30 07:10:27 user nova-compute[75293]:         <nova:port uuid="fd8381e1-d2ff-4b1c-a6ed-704604abc20d">
Nov 30 07:10:27 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 07:10:27 user nova-compute[75293]:         </nova:port>
Nov 30 07:10:27 user nova-compute[75293]:       </nova:ports>
Nov 30 07:10:27 user nova-compute[75293]:     </nova:instance>
Nov 30 07:10:27 user nova-compute[75293]:   </metadata>
Nov 30 07:10:27 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:10:27 user nova-compute[75293]:     <system>
Nov 30 07:10:27 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:10:27 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:10:27 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:10:27 user nova-compute[75293]:       <entry name="serial">1d2d8481-7c11-42dd-b60f-0129aa3d3ec8</entry>
Nov 30 07:10:27 user nova-compute[75293]:       <entry name="uuid">1d2d8481-7c11-42dd-b60f-0129aa3d3ec8</entry>
Nov 30 07:10:27 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:10:27 user nova-compute[75293]:     </system>
Nov 30 07:10:27 user nova-compute[75293]:   </sysinfo>
Nov 30 07:10:27 user nova-compute[75293]:   <os>
Nov 30 07:10:27 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:10:27 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:10:27 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:10:27 user nova-compute[75293]:   </os>
Nov 30 07:10:27 user nova-compute[75293]:   <features>
Nov 30 07:10:27 user nova-compute[75293]:     <acpi/>
Nov 30 07:10:27 user nova-compute[75293]:     <apic/>
Nov 30 07:10:27 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:10:27 user nova-compute[75293]:   </features>
Nov 30 07:10:27 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:10:27 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:10:27 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:10:27 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:10:27 user nova-compute[75293]:   </clock>
Nov 30 07:10:27 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:10:27 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:10:27 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:10:27 user nova-compute[75293]:   </cpu>
Nov 30 07:10:27 user nova-compute[75293]:   <devices>
Nov 30 07:10:27 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:10:27 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:10:27 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk"/>
Nov 30 07:10:27 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:10:27 user nova-compute[75293]:     </disk>
Nov 30 07:10:27 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:10:27 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:10:27 user nova-compute[75293]:       <source dev="/dev/sdb"/>
Nov 30 07:10:27 user nova-compute[75293]:       <target dev="vdb" bus="virtio"/>
Nov 30 07:10:27 user nova-compute[75293]:       <serial>70c2fd19-a79e-4b40-8116-072dafa1a09d</serial>
Nov 30 07:10:27 user nova-compute[75293]:     </disk>
Nov 30 07:10:27 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:10:27 user nova-compute[75293]:       <mac address="fa:16:3e:37:51:4d"/>
Nov 30 07:10:27 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:10:27 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:10:27 user nova-compute[75293]:       <target dev="tapfd8381e1-d2"/>
Nov 30 07:10:27 user nova-compute[75293]:     </interface>
Nov 30 07:10:27 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:10:27 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/console.log" append="off"/>
Nov 30 07:10:27 user nova-compute[75293]:     </serial>
Nov 30 07:10:27 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:10:27 user nova-compute[75293]:     <video>
Nov 30 07:10:27 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:10:27 user nova-compute[75293]:     </video>
Nov 30 07:10:27 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:10:27 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:10:27 user nova-compute[75293]:     </rng>
Nov 30 07:10:27 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:10:27 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:10:27 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:10:27 user nova-compute[75293]:     </memballoon>
Nov 30 07:10:27 user nova-compute[75293]:   </devices>
Nov 30 07:10:27 user nova-compute[75293]: </domain>
Nov 30 07:10:27 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:10:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG nova.objects.instance [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG nova.objects.base [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Object Instance<1d2d8481-7c11-42dd-b60f-0129aa3d3ec8> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2a3299330f813c7c63ba937d6c15e833ef51b1a --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2a3299330f813c7c63ba937d6c15e833ef51b1a --force-share --output=json" returned: 0 in 0.208s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Cannot resize image /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG nova.objects.instance [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lazy-loading 'migration_context' on Instance uuid 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG nova.objects.base [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Object Instance<1d2d8481-7c11-42dd-b60f-0129aa3d3ec8> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:08:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1186982627',display_name='tempest-TestMinimumBasicScenario-server-1186982627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1186982627',id=10,image_ref='a1bf2a8e-e3eb-4347-ab61-743834e154b1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMsqMmo5y5nrEe5/EAysBz/TZmoUguWfKbQBA8gdmeoccDDnOAjy5UCqnVUy3WWOjscjA4KGhVhWlQXcLk+3JBDwSAjPrQ2phWWgCzGRSuo5bA6deESyxfSvJVRmTiGJw==',key_name='tempest-TestMinimumBasicScenario-1562981580',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:08:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='995a27035c0c4b59b4bc11ef5ed479e7',ramdisk_id='',reservation_id='r-bz3g0w69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a1bf2a8e-e3eb-4347-ab61-743834e154b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1736397132',owner_user_name='tempest-TestMinimumBasicScenario-1736397132-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:10:25Z,user_data=None,user_id='6c37e36f7b5c4dfe815886140d24ea26',uuid=1d2d8481-7c11-42dd-b60f-0129aa3d3ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Converting VIF {"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:51:4d,bridge_name='br-int',has_traffic_filtering=True,id=fd8381e1-d2ff-4b1c-a6ed-704604abc20d,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd8381e1-d2') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG os_vif [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:51:4d,bridge_name='br-int',has_traffic_filtering=True,id=fd8381e1-d2ff-4b1c-a6ed-704604abc20d,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd8381e1-d2') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a49e63b1-6ff0-53b5-b0c7-384ff938144b', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd8381e1-d2, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd8381e1-d2, col_values=(('qos', UUID('ab87a89d-3d2f-448b-8947-b2ac74bfc06c')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd8381e1-d2, col_values=(('external_ids', {'iface-id': 'fd8381e1-d2ff-4b1c-a6ed-704604abc20d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:51:4d', 'vm-uuid': '1d2d8481-7c11-42dd-b60f-0129aa3d3ec8'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:28 user nova-compute[75293]: INFO os_vif [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:51:4d,bridge_name='br-int',has_traffic_filtering=True,id=fd8381e1-d2ff-4b1c-a6ed-704604abc20d,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd8381e1-d2')
Nov 30 07:10:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-62bf823b-91c2-46c6-a63c-ac8425210ffa req-950af940-6cfc-4b23-b57f-8c23beaf0f48 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received event network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-62bf823b-91c2-46c6-a63c-ac8425210ffa req-950af940-6cfc-4b23-b57f-8c23beaf0f48 service nova] Acquiring lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-62bf823b-91c2-46c6-a63c-ac8425210ffa req-950af940-6cfc-4b23-b57f-8c23beaf0f48 service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-62bf823b-91c2-46c6-a63c-ac8425210ffa req-950af940-6cfc-4b23-b57f-8c23beaf0f48 service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-62bf823b-91c2-46c6-a63c-ac8425210ffa req-950af940-6cfc-4b23-b57f-8c23beaf0f48 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] No waiting events found dispatching network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:30 user nova-compute[75293]: WARNING nova.compute.manager [req-62bf823b-91c2-46c6-a63c-ac8425210ffa req-950af940-6cfc-4b23-b57f-8c23beaf0f48 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received unexpected event network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d for instance with vm_state active and task_state reboot_started_hard.
Nov 30 07:10:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-e409bf61-19d9-4cca-b01d-9ae5bcb57695 req-4108cecc-3d90-4587-b53b-a6f86f31157d service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received event network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e409bf61-19d9-4cca-b01d-9ae5bcb57695 req-4108cecc-3d90-4587-b53b-a6f86f31157d service nova] Acquiring lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e409bf61-19d9-4cca-b01d-9ae5bcb57695 req-4108cecc-3d90-4587-b53b-a6f86f31157d service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e409bf61-19d9-4cca-b01d-9ae5bcb57695 req-4108cecc-3d90-4587-b53b-a6f86f31157d service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-e409bf61-19d9-4cca-b01d-9ae5bcb57695 req-4108cecc-3d90-4587-b53b-a6f86f31157d service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] No waiting events found dispatching network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:32 user nova-compute[75293]: WARNING nova.compute.manager [req-e409bf61-19d9-4cca-b01d-9ae5bcb57695 req-4108cecc-3d90-4587-b53b-a6f86f31157d service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received unexpected event network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d for instance with vm_state active and task_state reboot_started_hard.
Nov 30 07:10:32 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:10:32 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Instance rebooted successfully.
Nov 30 07:10:32 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:10:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b93b5c3b-f7af-4a90-a50e-5d088d0215f3 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.519s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Acquiring lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Acquiring lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:33 user nova-compute[75293]: INFO nova.compute.manager [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Terminating instance
Nov 30 07:10:33 user nova-compute[75293]: DEBUG nova.compute.manager [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG nova.compute.manager [req-d3947423-3ae9-4ad6-a447-61ce264fbdfe req-bd319dc0-3128-49d1-b8a7-18daee84fac1 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Received event network-vif-unplugged-ca13e5bf-0c02-4a9d-b23f-079495c5a34f {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d3947423-3ae9-4ad6-a447-61ce264fbdfe req-bd319dc0-3128-49d1-b8a7-18daee84fac1 service nova] Acquiring lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d3947423-3ae9-4ad6-a447-61ce264fbdfe req-bd319dc0-3128-49d1-b8a7-18daee84fac1 service nova] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d3947423-3ae9-4ad6-a447-61ce264fbdfe req-bd319dc0-3128-49d1-b8a7-18daee84fac1 service nova] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG nova.compute.manager [req-d3947423-3ae9-4ad6-a447-61ce264fbdfe req-bd319dc0-3128-49d1-b8a7-18daee84fac1 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] No waiting events found dispatching network-vif-unplugged-ca13e5bf-0c02-4a9d-b23f-079495c5a34f {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG nova.compute.manager [req-d3947423-3ae9-4ad6-a447-61ce264fbdfe req-bd319dc0-3128-49d1-b8a7-18daee84fac1 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Received event network-vif-unplugged-ca13e5bf-0c02-4a9d-b23f-079495c5a34f for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:34 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Instance destroyed successfully.
Nov 30 07:10:34 user nova-compute[75293]: DEBUG nova.objects.instance [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Lazy-loading 'resources' on Instance uuid ca1e65f3-8696-4c9a-b4df-ce5923e1de31 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:07:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2042976883',display_name='tempest-VolumesAssistedSnapshotsTest-server-2042976883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2042976883',id=9,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7GKfigl5zV0JYLHby10rpA2dlbr3g1zE8cWvuFx/57b0XEwC1jSswE9eLXJv2GECSNGX2AmMitX6LTg6oS83CHMAx+/YIEFaZ+HIclXYJNk3PPhH51Jjw5eUzamW8vbQ==',key_name='tempest-keypair-1270876363',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:07:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dda1342c66f8477a830d140c3791d1ea',ramdisk_id='',reservation_id='r-qjrlyj3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1277090279',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1277090279-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:07:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61406119263a4a979ca668162d9e676a',uuid=ca1e65f3-8696-4c9a-b4df-ce5923e1de31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "address": "fa:16:3e:5a:44:78", "network": {"id": "1dfb2052-19d3-4cbe-9043-b01739b9b90e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-6334978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda1342c66f8477a830d140c3791d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca13e5bf-0c", "ovs_interfaceid": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Converting VIF {"id": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "address": "fa:16:3e:5a:44:78", "network": {"id": "1dfb2052-19d3-4cbe-9043-b01739b9b90e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-6334978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda1342c66f8477a830d140c3791d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca13e5bf-0c", "ovs_interfaceid": "ca13e5bf-0c02-4a9d-b23f-079495c5a34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:44:78,bridge_name='br-int',has_traffic_filtering=True,id=ca13e5bf-0c02-4a9d-b23f-079495c5a34f,network=Network(1dfb2052-19d3-4cbe-9043-b01739b9b90e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca13e5bf-0c') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG os_vif [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:44:78,bridge_name='br-int',has_traffic_filtering=True,id=ca13e5bf-0c02-4a9d-b23f-079495c5a34f,network=Network(1dfb2052-19d3-4cbe-9043-b01739b9b90e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca13e5bf-0c') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca13e5bf-0c, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13958fd1-0f49-4ffc-9c54-79de355c71f1) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:34 user nova-compute[75293]: INFO os_vif [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:44:78,bridge_name='br-int',has_traffic_filtering=True,id=ca13e5bf-0c02-4a9d-b23f-079495c5a34f,network=Network(1dfb2052-19d3-4cbe-9043-b01739b9b90e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca13e5bf-0c')
Nov 30 07:10:34 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Deleting instance files /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31_del
Nov 30 07:10:34 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Deletion of /opt/stack/data/nova/instances/ca1e65f3-8696-4c9a-b4df-ce5923e1de31_del complete
Nov 30 07:10:34 user nova-compute[75293]: INFO nova.compute.manager [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 30 07:10:34 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:10:34 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:10:35 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:35 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Took 0.84 seconds to deallocate network for instance.
Nov 30 07:10:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:35 user nova-compute[75293]: DEBUG nova.compute.manager [req-015aaf56-6fee-48f9-86a0-8611679d6db5 req-ee025c10-0d73-43c6-8474-37112000ffd8 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Received event network-vif-deleted-ca13e5bf-0c02-4a9d-b23f-079495c5a34f {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:36 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:10:36 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:10:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:36 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Deleted allocations for instance ca1e65f3-8696-4c9a-b4df-ce5923e1de31
Nov 30 07:10:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9b188cf4-dd09-4e76-a1d0-a2babad32195 tempest-VolumesAssistedSnapshotsTest-1277090279 tempest-VolumesAssistedSnapshotsTest-1277090279-project-member] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.372s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:36 user nova-compute[75293]: DEBUG nova.compute.manager [req-c184406e-2c6f-4b06-9ac5-dc61ad92717d req-3de259fa-1afe-458a-8150-efd9003f6dc9 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Received event network-vif-plugged-ca13e5bf-0c02-4a9d-b23f-079495c5a34f {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c184406e-2c6f-4b06-9ac5-dc61ad92717d req-3de259fa-1afe-458a-8150-efd9003f6dc9 service nova] Acquiring lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c184406e-2c6f-4b06-9ac5-dc61ad92717d req-3de259fa-1afe-458a-8150-efd9003f6dc9 service nova] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c184406e-2c6f-4b06-9ac5-dc61ad92717d req-3de259fa-1afe-458a-8150-efd9003f6dc9 service nova] Lock "ca1e65f3-8696-4c9a-b4df-ce5923e1de31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:36 user nova-compute[75293]: DEBUG nova.compute.manager [req-c184406e-2c6f-4b06-9ac5-dc61ad92717d req-3de259fa-1afe-458a-8150-efd9003f6dc9 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] No waiting events found dispatching network-vif-plugged-ca13e5bf-0c02-4a9d-b23f-079495c5a34f {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:36 user nova-compute[75293]: WARNING nova.compute.manager [req-c184406e-2c6f-4b06-9ac5-dc61ad92717d req-3de259fa-1afe-458a-8150-efd9003f6dc9 service nova] [instance: ca1e65f3-8696-4c9a-b4df-ce5923e1de31] Received unexpected event network-vif-plugged-ca13e5bf-0c02-4a9d-b23f-079495c5a34f for instance with vm_state deleted and task_state None.
Nov 30 07:10:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:43 user nova-compute[75293]: DEBUG nova.objects.instance [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lazy-loading 'flavor' on Instance uuid 1b6dee8d-d419-47a3-b2be-4d15e17d6061 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:10:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:44 user nova-compute[75293]: INFO nova.compute.manager [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Attaching volume 5d80efc0-d30e-4484-a572-3839e3e01f8d to /dev/vdb
Nov 30 07:10:44 user nova-compute[75293]: DEBUG os_brick.utils [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74ebd75-2dac-4054-a613-8f39292899c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0f1db6-e5c0-4548-8cd9-378d1c4f2d95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd0beda-412b-4c42-aaf3-9a67a39be35f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff299642-c4a6-463c-90e0-0204135ac09a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:10:44 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:10:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1a6d2f-47e5-4a7a-aa18-f2d8151d3236]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG os_brick.utils [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] <== get_connector_properties: return (248ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Updating existing volume attachment record: fa5cd200-bff9-4dae-bb94-1dcc0792de65 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:10:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "009f70bc-7561-48fe-ba47-ebaf4d81d462" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:45 user nova-compute[75293]: DEBUG nova.compute.manager [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:10:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:45 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:10:45 user nova-compute[75293]: INFO nova.compute.claims [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Claim successful on node user
Nov 30 07:10:46 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG nova.compute.manager [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG nova.compute.manager [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG nova.network.neutron [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:10:46 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:10:46 user nova-compute[75293]: DEBUG nova.compute.manager [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "251604ac-b300-49ae-ae1a-4543665fead6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "251604ac-b300-49ae-ae1a-4543665fead6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:46 user nova-compute[75293]: INFO nova.compute.manager [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Unshelving
Nov 30 07:10:46 user nova-compute[75293]: DEBUG nova.policy [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '917adc7b254e4711ad5f5adbdd2689d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d94d0308eb444dbdcd3e5c7c21fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG nova.compute.manager [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:10:46 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Creating image(s)
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "/opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "/opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "/opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:46 user nova-compute[75293]: INFO nova.virt.block_device [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Booting with volume 1fd4498f-6a27-4f34-90e3-e80f4a1d16db at /dev/vdc
Nov 30 07:10:46 user nova-compute[75293]: DEBUG os_brick.utils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a612b40-e50b-4733-99b7-cdd62f652b8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0901bb-7088-4d61-aedf-55ca6b094e92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.193s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce0cadb-457a-4b04-bc8b-750a03ade483]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a777c466-9596-46a3-9176-b9f60382386e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:10:46 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:10:46 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd46fec-550b-409c-aa0f-e88741f0264c]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG os_brick.utils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:10:46 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Updating existing volume attachment record: e097ed67-afb0-47da-9a58-a78417cc582c {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.212s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk 1073741824" returned: 0 in 0.053s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.226s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Checking if we can resize image /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG nova.network.neutron [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Successfully created port: 3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Cannot resize image /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Ensure instance console log exists: /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.004s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquiring lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquiring lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:47 user nova-compute[75293]: INFO nova.compute.manager [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Terminating instance
Nov 30 07:10:47 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG nova.network.neutron [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Successfully updated port: 3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "refresh_cache-009f70bc-7561-48fe-ba47-ebaf4d81d462" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquired lock "refresh_cache-009f70bc-7561-48fe-ba47-ebaf4d81d462" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG nova.network.neutron [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG nova.compute.manager [req-d3ee0256-fc3c-4456-ac62-5061af1d0ae3 req-5e950a15-5717-43ba-93ab-d06518d78761 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Received event network-changed-3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG nova.compute.manager [req-d3ee0256-fc3c-4456-ac62-5061af1d0ae3 req-5e950a15-5717-43ba-93ab-d06518d78761 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Refreshing instance network info cache due to event network-changed-3d550d68-3322-4126-8dce-9201214e61f8. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d3ee0256-fc3c-4456-ac62-5061af1d0ae3 req-5e950a15-5717-43ba-93ab-d06518d78761 service nova] Acquiring lock "refresh_cache-009f70bc-7561-48fe-ba47-ebaf4d81d462" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG nova.network.neutron [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:10:48 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Instance destroyed successfully.
Nov 30 07:10:48 user nova-compute[75293]: DEBUG nova.objects.instance [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lazy-loading 'resources' on Instance uuid 67b8a66b-e7f8-41a1-8f5c-b29851ec608d {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-30T07:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-448272992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-448272992',id=7,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjlAvbNSNxOu5edth1vYgsFbUXzkyrWPcRf1ffRD5CrTsh6WZzOo54MVbNVFLS5n8k7/BjeCIsOHkQu7rwF07QgVmeG30dScHl8rc2yZM/6i1oYAPea7ho5miPIPyzMag==',key_name='tempest-keypair-2066695250',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:07:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67436111c10f475a9e2d249fe77f04c9',ramdisk_id='',reservation_id='r-p1eo2eq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-825521733',owner_user_name='tempest-TaggedAttachmentsTest-825521733-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:07:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3af22daef9746c99424bf6581cc7608',uuid=67b8a66b-e7f8-41a1-8f5c-b29851ec608d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "address": "fa:16:3e:2b:05:2c", "network": {"id": "ebc5494d-4e41-410c-a9ef-96a92a44d1d2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1004206243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4079c1bd-9b", "ovs_interfaceid": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Converting VIF {"id": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "address": "fa:16:3e:2b:05:2c", "network": {"id": "ebc5494d-4e41-410c-a9ef-96a92a44d1d2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1004206243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67436111c10f475a9e2d249fe77f04c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4079c1bd-9b", "ovs_interfaceid": "4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:05:2c,bridge_name='br-int',has_traffic_filtering=True,id=4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e,network=Network(ebc5494d-4e41-410c-a9ef-96a92a44d1d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4079c1bd-9b') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG os_vif [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:05:2c,bridge_name='br-int',has_traffic_filtering=True,id=4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e,network=Network(ebc5494d-4e41-410c-a9ef-96a92a44d1d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4079c1bd-9b') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4079c1bd-9b, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e99b068-2077-467f-94d8-5e50519081b0) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:48 user nova-compute[75293]: INFO os_vif [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:05:2c,bridge_name='br-int',has_traffic_filtering=True,id=4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e,network=Network(ebc5494d-4e41-410c-a9ef-96a92a44d1d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4079c1bd-9b')
Nov 30 07:10:48 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Deleting instance files /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d_del
Nov 30 07:10:48 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Deletion of /opt/stack/data/nova/instances/67b8a66b-e7f8-41a1-8f5c-b29851ec608d_del complete
Nov 30 07:10:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Acquiring lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Acquiring lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:48 user nova-compute[75293]: INFO nova.compute.manager [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Terminating instance
Nov 30 07:10:48 user nova-compute[75293]: DEBUG nova.compute.manager [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:10:48 user nova-compute[75293]: INFO nova.compute.manager [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 30 07:10:48 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:48 user nova-compute[75293]: DEBUG nova.network.neutron [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Updating instance_info_cache with network_info: [{"id": "3d550d68-3322-4126-8dce-9201214e61f8", "address": "fa:16:3e:79:15:d4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d550d68-33", "ovs_interfaceid": "3d550d68-3322-4126-8dce-9201214e61f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Releasing lock "refresh_cache-009f70bc-7561-48fe-ba47-ebaf4d81d462" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.compute.manager [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Instance network_info: |[{"id": "3d550d68-3322-4126-8dce-9201214e61f8", "address": "fa:16:3e:79:15:d4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d550d68-33", "ovs_interfaceid": "3d550d68-3322-4126-8dce-9201214e61f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d3ee0256-fc3c-4456-ac62-5061af1d0ae3 req-5e950a15-5717-43ba-93ab-d06518d78761 service nova] Acquired lock "refresh_cache-009f70bc-7561-48fe-ba47-ebaf4d81d462" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.network.neutron [req-d3ee0256-fc3c-4456-ac62-5061af1d0ae3 req-5e950a15-5717-43ba-93ab-d06518d78761 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Refreshing network info cache for port 3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Start _get_guest_xml network_info=[{"id": "3d550d68-3322-4126-8dce-9201214e61f8", "address": "fa:16:3e:79:15:d4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d550d68-33", "ovs_interfaceid": "3d550d68-3322-4126-8dce-9201214e61f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:10:49 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:10:49 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-418067200',display_name='tempest-tempest.common.compute-instance-418067200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-418067200',id=14,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2kLa2wHH9ln/DcE1mMyiHO9XBIKOTjYK22BOzhVHg5r0qn+BLS7JnYCSc645GeKcssQgl8lEq/PAj32RkQGtMjm7fEtz2pN4k+1RJtJOqNOhF7RahDUe4ozMYeynwFmw==',key_name='tempest-keypair-1656097843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7d94d0308eb444dbdcd3e5c7c21fe79',ramdisk_id='',reservation_id='r-letc0pyj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1263829597',owner_user_name='tempest-ServerActionsTestOtherA-1263829597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='917adc7b254e4711ad5f5adbdd2689d4',uuid=009f70bc-7561-48fe-ba47-ebaf4d81d462,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d550d68-3322-4126-8dce-9201214e61f8", "address": "fa:16:3e:79:15:d4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d550d68-33", "ovs_interfaceid": "3d550d68-3322-4126-8dce-9201214e61f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converting VIF {"id": "3d550d68-3322-4126-8dce-9201214e61f8", "address": "fa:16:3e:79:15:d4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d550d68-33", "ovs_interfaceid": "3d550d68-3322-4126-8dce-9201214e61f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:15:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d550d68-3322-4126-8dce-9201214e61f8,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d550d68-33') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.objects.instance [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lazy-loading 'pci_devices' on Instance uuid 009f70bc-7561-48fe-ba47-ebaf4d81d462 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:10:49 user nova-compute[75293]:   <uuid>009f70bc-7561-48fe-ba47-ebaf4d81d462</uuid>
Nov 30 07:10:49 user nova-compute[75293]:   <name>instance-0000000e</name>
Nov 30 07:10:49 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:10:49 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:10:49 user nova-compute[75293]:   <metadata>
Nov 30 07:10:49 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:10:49 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:10:49 user nova-compute[75293]:       <nova:name>tempest-tempest.common.compute-instance-418067200</nova:name>
Nov 30 07:10:49 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:10:49</nova:creationTime>
Nov 30 07:10:49 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:10:49 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:10:49 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:10:49 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:10:49 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:10:49 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:10:49 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:10:49 user nova-compute[75293]:       <nova:owner>
Nov 30 07:10:49 user nova-compute[75293]:         <nova:user uuid="917adc7b254e4711ad5f5adbdd2689d4">tempest-ServerActionsTestOtherA-1263829597-project-member</nova:user>
Nov 30 07:10:49 user nova-compute[75293]:         <nova:project uuid="b7d94d0308eb444dbdcd3e5c7c21fe79">tempest-ServerActionsTestOtherA-1263829597</nova:project>
Nov 30 07:10:49 user nova-compute[75293]:       </nova:owner>
Nov 30 07:10:49 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:10:49 user nova-compute[75293]:       <nova:ports>
Nov 30 07:10:49 user nova-compute[75293]:         <nova:port uuid="3d550d68-3322-4126-8dce-9201214e61f8">
Nov 30 07:10:49 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 07:10:49 user nova-compute[75293]:         </nova:port>
Nov 30 07:10:49 user nova-compute[75293]:       </nova:ports>
Nov 30 07:10:49 user nova-compute[75293]:     </nova:instance>
Nov 30 07:10:49 user nova-compute[75293]:   </metadata>
Nov 30 07:10:49 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:10:49 user nova-compute[75293]:     <system>
Nov 30 07:10:49 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:10:49 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:10:49 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:10:49 user nova-compute[75293]:       <entry name="serial">009f70bc-7561-48fe-ba47-ebaf4d81d462</entry>
Nov 30 07:10:49 user nova-compute[75293]:       <entry name="uuid">009f70bc-7561-48fe-ba47-ebaf4d81d462</entry>
Nov 30 07:10:49 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:10:49 user nova-compute[75293]:     </system>
Nov 30 07:10:49 user nova-compute[75293]:   </sysinfo>
Nov 30 07:10:49 user nova-compute[75293]:   <os>
Nov 30 07:10:49 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:10:49 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:10:49 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:10:49 user nova-compute[75293]:   </os>
Nov 30 07:10:49 user nova-compute[75293]:   <features>
Nov 30 07:10:49 user nova-compute[75293]:     <acpi/>
Nov 30 07:10:49 user nova-compute[75293]:     <apic/>
Nov 30 07:10:49 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:10:49 user nova-compute[75293]:   </features>
Nov 30 07:10:49 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:10:49 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:10:49 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:10:49 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:10:49 user nova-compute[75293]:   </clock>
Nov 30 07:10:49 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:10:49 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:10:49 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:10:49 user nova-compute[75293]:   </cpu>
Nov 30 07:10:49 user nova-compute[75293]:   <devices>
Nov 30 07:10:49 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:10:49 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:10:49 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk"/>
Nov 30 07:10:49 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:10:49 user nova-compute[75293]:     </disk>
Nov 30 07:10:49 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:10:49 user nova-compute[75293]:       <mac address="fa:16:3e:79:15:d4"/>
Nov 30 07:10:49 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:10:49 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:10:49 user nova-compute[75293]:       <target dev="tap3d550d68-33"/>
Nov 30 07:10:49 user nova-compute[75293]:     </interface>
Nov 30 07:10:49 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:10:49 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/console.log" append="off"/>
Nov 30 07:10:49 user nova-compute[75293]:     </serial>
Nov 30 07:10:49 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:10:49 user nova-compute[75293]:     <video>
Nov 30 07:10:49 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:10:49 user nova-compute[75293]:     </video>
Nov 30 07:10:49 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:10:49 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:10:49 user nova-compute[75293]:     </rng>
Nov 30 07:10:49 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:10:49 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:10:49 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:10:49 user nova-compute[75293]:     </memballoon>
Nov 30 07:10:49 user nova-compute[75293]:   </devices>
Nov 30 07:10:49 user nova-compute[75293]: </domain>
Nov 30 07:10:49 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-418067200',display_name='tempest-tempest.common.compute-instance-418067200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-418067200',id=14,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2kLa2wHH9ln/DcE1mMyiHO9XBIKOTjYK22BOzhVHg5r0qn+BLS7JnYCSc645GeKcssQgl8lEq/PAj32RkQGtMjm7fEtz2pN4k+1RJtJOqNOhF7RahDUe4ozMYeynwFmw==',key_name='tempest-keypair-1656097843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7d94d0308eb444dbdcd3e5c7c21fe79',ramdisk_id='',reservation_id='r-letc0pyj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1263829597',owner_user_name='tempest-ServerActionsTestOtherA-1263829597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='917adc7b254e4711ad5f5adbdd2689d4',uuid=009f70bc-7561-48fe-ba47-ebaf4d81d462,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d550d68-3322-4126-8dce-9201214e61f8", "address": "fa:16:3e:79:15:d4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d550d68-33", "ovs_interfaceid": "3d550d68-3322-4126-8dce-9201214e61f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converting VIF {"id": "3d550d68-3322-4126-8dce-9201214e61f8", "address": "fa:16:3e:79:15:d4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d550d68-33", "ovs_interfaceid": "3d550d68-3322-4126-8dce-9201214e61f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:15:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d550d68-3322-4126-8dce-9201214e61f8,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d550d68-33') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG os_vif [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:15:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d550d68-3322-4126-8dce-9201214e61f8,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d550d68-33') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32111a97-3d5d-56fa-8b29-e6664aa314e8', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d550d68-33, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d550d68-33, col_values=(('qos', UUID('11fdfefc-eea8-4935-8262-990f4a6b1566')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d550d68-33, col_values=(('external_ids', {'iface-id': '3d550d68-3322-4126-8dce-9201214e61f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:15:d4', 'vm-uuid': '009f70bc-7561-48fe-ba47-ebaf4d81d462'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:49 user nova-compute[75293]: INFO os_vif [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:15:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d550d68-3322-4126-8dce-9201214e61f8,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d550d68-33')
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.compute.manager [req-5977bd37-29db-42ce-a1ee-25162805c713 req-bb710e2d-c15c-42e5-a602-6cf3686b59c1 service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Received event network-vif-unplugged-60fdc1a9-8616-40a3-9380-b675ff1b3239 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5977bd37-29db-42ce-a1ee-25162805c713 req-bb710e2d-c15c-42e5-a602-6cf3686b59c1 service nova] Acquiring lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5977bd37-29db-42ce-a1ee-25162805c713 req-bb710e2d-c15c-42e5-a602-6cf3686b59c1 service nova] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5977bd37-29db-42ce-a1ee-25162805c713 req-bb710e2d-c15c-42e5-a602-6cf3686b59c1 service nova] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.compute.manager [req-5977bd37-29db-42ce-a1ee-25162805c713 req-bb710e2d-c15c-42e5-a602-6cf3686b59c1 service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] No waiting events found dispatching network-vif-unplugged-60fdc1a9-8616-40a3-9380-b675ff1b3239 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.compute.manager [req-5977bd37-29db-42ce-a1ee-25162805c713 req-bb710e2d-c15c-42e5-a602-6cf3686b59c1 service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Received event network-vif-unplugged-60fdc1a9-8616-40a3-9380-b675ff1b3239 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] No VIF found with MAC fa:16:3e:79:15:d4, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:49 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Instance destroyed successfully.
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.objects.instance [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lazy-loading 'resources' on Instance uuid dcd1ca28-3784-45b3-a3d3-e3231d8e82bb {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1302031079',display_name='tempest-TestVolumeSwap-server-1302031079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1302031079',id=5,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEzAcOrRtFHkoAWbWt7bFOGLuIJulXu3F2Rz6BqNzmgRnIqDla3n+ON4yPeNFaHU726QsCAmpkKL0hIZihRliyV4fmnhMaE0VqV2GeKMLAZCdr/4eXXrC4GjDu04gyfaQ==',key_name='tempest-keypair-1061253891',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:07:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a232105c95a42669fd04b62416ded2f',ramdisk_id='',reservation_id='r-aohjr03f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1605433774',owner_user_name='tempest-TestVolumeSwap-1605433774-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:07:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f2845232e8441c482acdb2c5f63c389',uuid=dcd1ca28-3784-45b3-a3d3-e3231d8e82bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "address": "fa:16:3e:70:14:32", "network": {"id": "874f6f69-e233-46c8-b3a1-1e056bb291f2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1191377101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a232105c95a42669fd04b62416ded2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fdc1a9-86", "ovs_interfaceid": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Converting VIF {"id": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "address": "fa:16:3e:70:14:32", "network": {"id": "874f6f69-e233-46c8-b3a1-1e056bb291f2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1191377101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a232105c95a42669fd04b62416ded2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fdc1a9-86", "ovs_interfaceid": "60fdc1a9-8616-40a3-9380-b675ff1b3239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:14:32,bridge_name='br-int',has_traffic_filtering=True,id=60fdc1a9-8616-40a3-9380-b675ff1b3239,network=Network(874f6f69-e233-46c8-b3a1-1e056bb291f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60fdc1a9-86') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG os_vif [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:14:32,bridge_name='br-int',has_traffic_filtering=True,id=60fdc1a9-8616-40a3-9380-b675ff1b3239,network=Network(874f6f69-e233-46c8-b3a1-1e056bb291f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60fdc1a9-86') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60fdc1a9-86, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38333934-e56a-4699-8e69-96673e28576e) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:49 user nova-compute[75293]: INFO os_vif [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:14:32,bridge_name='br-int',has_traffic_filtering=True,id=60fdc1a9-8616-40a3-9380-b675ff1b3239,network=Network(874f6f69-e233-46c8-b3a1-1e056bb291f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60fdc1a9-86')
Nov 30 07:10:49 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Deleting instance files /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb_del
Nov 30 07:10:49 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Deletion of /opt/stack/data/nova/instances/dcd1ca28-3784-45b3-a3d3-e3231d8e82bb_del complete
Nov 30 07:10:49 user nova-compute[75293]: INFO nova.compute.manager [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 30 07:10:49 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:10:49 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG nova.network.neutron [req-d3ee0256-fc3c-4456-ac62-5061af1d0ae3 req-5e950a15-5717-43ba-93ab-d06518d78761 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Updated VIF entry in instance network info cache for port 3d550d68-3322-4126-8dce-9201214e61f8. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG nova.network.neutron [req-d3ee0256-fc3c-4456-ac62-5061af1d0ae3 req-5e950a15-5717-43ba-93ab-d06518d78761 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Updating instance_info_cache with network_info: [{"id": "3d550d68-3322-4126-8dce-9201214e61f8", "address": "fa:16:3e:79:15:d4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d550d68-33", "ovs_interfaceid": "3d550d68-3322-4126-8dce-9201214e61f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG nova.compute.manager [req-14f3c230-3653-47d2-b4b1-0b5fe1c27d7f req-6639f355-b2eb-4cb1-8e19-d78e67b86c79 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received event network-vif-unplugged-4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-14f3c230-3653-47d2-b4b1-0b5fe1c27d7f req-6639f355-b2eb-4cb1-8e19-d78e67b86c79 service nova] Acquiring lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-14f3c230-3653-47d2-b4b1-0b5fe1c27d7f req-6639f355-b2eb-4cb1-8e19-d78e67b86c79 service nova] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-14f3c230-3653-47d2-b4b1-0b5fe1c27d7f req-6639f355-b2eb-4cb1-8e19-d78e67b86c79 service nova] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG nova.compute.manager [req-14f3c230-3653-47d2-b4b1-0b5fe1c27d7f req-6639f355-b2eb-4cb1-8e19-d78e67b86c79 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] No waiting events found dispatching network-vif-unplugged-4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG nova.compute.manager [req-14f3c230-3653-47d2-b4b1-0b5fe1c27d7f req-6639f355-b2eb-4cb1-8e19-d78e67b86c79 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received event network-vif-unplugged-4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG nova.compute.manager [req-14f3c230-3653-47d2-b4b1-0b5fe1c27d7f req-6639f355-b2eb-4cb1-8e19-d78e67b86c79 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received event network-vif-plugged-4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-14f3c230-3653-47d2-b4b1-0b5fe1c27d7f req-6639f355-b2eb-4cb1-8e19-d78e67b86c79 service nova] Acquiring lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-14f3c230-3653-47d2-b4b1-0b5fe1c27d7f req-6639f355-b2eb-4cb1-8e19-d78e67b86c79 service nova] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-14f3c230-3653-47d2-b4b1-0b5fe1c27d7f req-6639f355-b2eb-4cb1-8e19-d78e67b86c79 service nova] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG nova.compute.manager [req-14f3c230-3653-47d2-b4b1-0b5fe1c27d7f req-6639f355-b2eb-4cb1-8e19-d78e67b86c79 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] No waiting events found dispatching network-vif-plugged-4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:50 user nova-compute[75293]: WARNING nova.compute.manager [req-14f3c230-3653-47d2-b4b1-0b5fe1c27d7f req-6639f355-b2eb-4cb1-8e19-d78e67b86c79 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received unexpected event network-vif-plugged-4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e for instance with vm_state active and task_state deleting.
Nov 30 07:10:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d3ee0256-fc3c-4456-ac62-5061af1d0ae3 req-5e950a15-5717-43ba-93ab-d06518d78761 service nova] Releasing lock "refresh_cache-009f70bc-7561-48fe-ba47-ebaf4d81d462" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:50 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Took 1.80 seconds to deallocate network for instance.
Nov 30 07:10:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:51 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:10:51 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:10:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:51 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Deleted allocations for instance 67b8a66b-e7f8-41a1-8f5c-b29851ec608d
Nov 30 07:10:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f532036f-3b5a-49ce-8639-9042ca24969d tempest-TaggedAttachmentsTest-825521733 tempest-TaggedAttachmentsTest-825521733-project-member] Lock "67b8a66b-e7f8-41a1-8f5c-b29851ec608d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.507s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:51 user nova-compute[75293]: DEBUG nova.compute.manager [req-8e02c78a-2ba0-453f-a66d-222f12e41f67 req-be0fe914-eace-4bab-9961-f337d91be0b8 service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Received event network-vif-plugged-60fdc1a9-8616-40a3-9380-b675ff1b3239 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8e02c78a-2ba0-453f-a66d-222f12e41f67 req-be0fe914-eace-4bab-9961-f337d91be0b8 service nova] Acquiring lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8e02c78a-2ba0-453f-a66d-222f12e41f67 req-be0fe914-eace-4bab-9961-f337d91be0b8 service nova] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8e02c78a-2ba0-453f-a66d-222f12e41f67 req-be0fe914-eace-4bab-9961-f337d91be0b8 service nova] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:51 user nova-compute[75293]: DEBUG nova.compute.manager [req-8e02c78a-2ba0-453f-a66d-222f12e41f67 req-be0fe914-eace-4bab-9961-f337d91be0b8 service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] No waiting events found dispatching network-vif-plugged-60fdc1a9-8616-40a3-9380-b675ff1b3239 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:51 user nova-compute[75293]: WARNING nova.compute.manager [req-8e02c78a-2ba0-453f-a66d-222f12e41f67 req-be0fe914-eace-4bab-9961-f337d91be0b8 service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Received unexpected event network-vif-plugged-60fdc1a9-8616-40a3-9380-b675ff1b3239 for instance with vm_state active and task_state deleting.
Nov 30 07:10:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:51 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:51 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Took 1.96 seconds to deallocate network for instance.
Nov 30 07:10:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:52 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:10:52 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:10:52 user nova-compute[75293]: DEBUG nova.compute.manager [req-ade08d64-23ea-4b0e-bceb-9884e5bbfcb8 req-8392e5ce-8b15-4030-8e64-b723a3d7d373 service nova] [instance: 67b8a66b-e7f8-41a1-8f5c-b29851ec608d] Received event network-vif-deleted-4079c1bd-9b06-4c94-81f2-9f3c9ddcd18e {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:52 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Deleted allocations for instance dcd1ca28-3784-45b3-a3d3-e3231d8e82bb
Nov 30 07:10:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-425eef45-3ae7-45d3-93a3-9e395df82bbe tempest-TestVolumeSwap-1605433774 tempest-TestVolumeSwap-1605433774-project-member] Lock "dcd1ca28-3784-45b3-a3d3-e3231d8e82bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.883s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:53 user nova-compute[75293]: DEBUG nova.compute.manager [req-fc558d4d-ae1e-4410-9079-d22fa6d6d204 req-00cb18b4-210e-4981-87a6-ed11c085b854 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Received event network-vif-plugged-3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fc558d4d-ae1e-4410-9079-d22fa6d6d204 req-00cb18b4-210e-4981-87a6-ed11c085b854 service nova] Acquiring lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fc558d4d-ae1e-4410-9079-d22fa6d6d204 req-00cb18b4-210e-4981-87a6-ed11c085b854 service nova] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fc558d4d-ae1e-4410-9079-d22fa6d6d204 req-00cb18b4-210e-4981-87a6-ed11c085b854 service nova] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:53 user nova-compute[75293]: DEBUG nova.compute.manager [req-fc558d4d-ae1e-4410-9079-d22fa6d6d204 req-00cb18b4-210e-4981-87a6-ed11c085b854 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] No waiting events found dispatching network-vif-plugged-3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:53 user nova-compute[75293]: WARNING nova.compute.manager [req-fc558d4d-ae1e-4410-9079-d22fa6d6d204 req-00cb18b4-210e-4981-87a6-ed11c085b854 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Received unexpected event network-vif-plugged-3d550d68-3322-4126-8dce-9201214e61f8 for instance with vm_state building and task_state spawning.
Nov 30 07:10:53 user nova-compute[75293]: DEBUG nova.compute.manager [req-fc558d4d-ae1e-4410-9079-d22fa6d6d204 req-00cb18b4-210e-4981-87a6-ed11c085b854 service nova] [instance: dcd1ca28-3784-45b3-a3d3-e3231d8e82bb] Received event network-vif-deleted-60fdc1a9-8616-40a3-9380-b675ff1b3239 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:53 user nova-compute[75293]: DEBUG nova.compute.manager [req-fc558d4d-ae1e-4410-9079-d22fa6d6d204 req-00cb18b4-210e-4981-87a6-ed11c085b854 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Received event network-vif-plugged-3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:10:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fc558d4d-ae1e-4410-9079-d22fa6d6d204 req-00cb18b4-210e-4981-87a6-ed11c085b854 service nova] Acquiring lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fc558d4d-ae1e-4410-9079-d22fa6d6d204 req-00cb18b4-210e-4981-87a6-ed11c085b854 service nova] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fc558d4d-ae1e-4410-9079-d22fa6d6d204 req-00cb18b4-210e-4981-87a6-ed11c085b854 service nova] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:53 user nova-compute[75293]: DEBUG nova.compute.manager [req-fc558d4d-ae1e-4410-9079-d22fa6d6d204 req-00cb18b4-210e-4981-87a6-ed11c085b854 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] No waiting events found dispatching network-vif-plugged-3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:10:53 user nova-compute[75293]: WARNING nova.compute.manager [req-fc558d4d-ae1e-4410-9079-d22fa6d6d204 req-00cb18b4-210e-4981-87a6-ed11c085b854 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Received unexpected event network-vif-plugged-3d550d68-3322-4126-8dce-9201214e61f8 for instance with vm_state building and task_state spawning.
Nov 30 07:10:54 user nova-compute[75293]: DEBUG nova.compute.manager [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:10:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:10:54 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Instance spawned successfully.
Nov 30 07:10:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:10:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:10:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:10:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:10:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:10:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:10:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:10:54 user nova-compute[75293]: INFO nova.compute.manager [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Took 7.85 seconds to spawn the instance on the hypervisor.
Nov 30 07:10:54 user nova-compute[75293]: DEBUG nova.compute.manager [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:10:54 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:10:54 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:10:54 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:10:54 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:10:54 user nova-compute[75293]: INFO nova.compute.manager [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Took 8.69 seconds to build instance.
Nov 30 07:10:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-062c89f6-9598-4ce3-b353-c3260dc05b71 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.252s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qyovIDVz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:10:55 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:10:55 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:10:55 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9367e4b0-61b7-433d-b69e-f4f6755cbac4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:10:55 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.035s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d91626-d743-4c0d-80fd-b74a3723eea0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d] added
Nov 30 07:10:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-061832ab-930a-470b-8b4f-dfc8f19fea6b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-061832ab-930a-470b-8b4f-dfc8f19fea6b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.054s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[764d12cf-270f-476e-acd8-ae7fbb82b6af]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[998c5ced-483b-4659-aabd-cc246f1c3bd3]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qyovIDVz {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qyovIDVz" returned: 0 in 0.034s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefdc1f0-e955-4664-b0a6-7e0204acdea6]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qyovIDVz'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf77e672-6ee6-42ba-9988-00aac9e04e64]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da3bb20-5b28-40f0-9286-6bb714e8e4b9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:10:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:10:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1003439e-eeed-48f7-8201-bbf967ed777d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d, portal: 172.16.0.220,3260]
Nov 30 07:10:55 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d, portal: 172.16.0.220,3260] successful.
Nov 30 07:10:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff8dc9b-96f6-4a63-a271-1622644c5ff5]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09f6b73-a30f-42fc-ac94-9e3aff1a98a6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:10:55 user nova-compute[75293]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:10:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:10:55 user nova-compute[75293]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:10:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bc2a9f-52b7-48da-b0d6-f839d158caac]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: None {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:10:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Updating instance_info_cache with network_info: [{"id": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "address": "fa:16:3e:0a:7f:0a", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693d3de2-b9", "ovs_interfaceid": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-061832ab-930a-470b-8b4f-dfc8f19fea6b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qyovIDVz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '26434353639303336', 'path': '/dev/sdc'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434353639303336', 'path': '/dev/sdc'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG nova.objects.instance [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lazy-loading 'flavor' on Instance uuid 1b6dee8d-d419-47a3-b2be-4d15e17d6061 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:10:56 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:10:56 user nova-compute[75293]:   <source dev="/dev/sdc"/>
Nov 30 07:10:56 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:10:56 user nova-compute[75293]:   <serial>5d80efc0-d30e-4484-a572-3839e3e01f8d</serial>
Nov 30 07:10:56 user nova-compute[75293]: </disk>
Nov 30 07:10:56 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:10:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:10:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] No VIF found with MAC fa:16:3e:c6:2c:81, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:10:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3a28a4ec-68f5-4ec6-81c8-615bf77601ff tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.611s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:10:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:10:58 user nova-compute[75293]: DEBUG nova.objects.instance [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'pci_requests' on Instance uuid 251604ac-b300-49ae-ae1a-4543665fead6 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:10:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:58 user nova-compute[75293]: DEBUG nova.objects.instance [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'numa_topology' on Instance uuid 251604ac-b300-49ae-ae1a-4543665fead6 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:10:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:58 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:10:58 user nova-compute[75293]: INFO nova.compute.claims [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Claim successful on node user
Nov 30 07:10:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:58 user nova-compute[75293]: INFO nova.compute.manager [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Rescuing
Nov 30 07:10:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:10:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquired lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:10:58 user nova-compute[75293]: DEBUG nova.network.neutron [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:10:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:59 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:10:59 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:10:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:10:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:10:59 user nova-compute[75293]: INFO nova.network.neutron [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Updating port 7cf6968f-9b43-4e24-9ade-d296716616fe with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 30 07:10:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:10:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:10:59 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:10:59 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:10:59 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=8003MB free_disk=25.46600341796875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:10:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:10:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b6dee8d-d419-47a3-b2be-4d15e17d6061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b7deb0a-39af-4d93-b93d-5765a731f702 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 061832ab-930a-470b-8b4f-dfc8f19fea6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 5c5d7382-107c-49af-bdc5-3600ab6425e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 009f70bc-7561-48fe-ba47-ebaf4d81d462 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG nova.network.neutron [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Updating instance_info_cache with network_info: [{"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Releasing lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquired lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG nova.network.neutron [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-62eed224-3115-4bd0-9e29-884f389fe347 req-c9a484b8-9aa6-442e-835c-94f8cda80f69 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received event network-changed-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-62eed224-3115-4bd0-9e29-884f389fe347 req-c9a484b8-9aa6-442e-835c-94f8cda80f69 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Refreshing instance network info cache due to event network-changed-7cf6968f-9b43-4e24-9ade-d296716616fe. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-62eed224-3115-4bd0-9e29-884f389fe347 req-c9a484b8-9aa6-442e-835c-94f8cda80f69 service nova] Acquiring lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-5cb33d82-76bc-4a88-92b2-38569ce267c6 req-484a5169-b79d-425e-8ba9-2ad0b09fdc9e service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-vif-unplugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5cb33d82-76bc-4a88-92b2-38569ce267c6 req-484a5169-b79d-425e-8ba9-2ad0b09fdc9e service nova] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5cb33d82-76bc-4a88-92b2-38569ce267c6 req-484a5169-b79d-425e-8ba9-2ad0b09fdc9e service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5cb33d82-76bc-4a88-92b2-38569ce267c6 req-484a5169-b79d-425e-8ba9-2ad0b09fdc9e service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-5cb33d82-76bc-4a88-92b2-38569ce267c6 req-484a5169-b79d-425e-8ba9-2ad0b09fdc9e service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] No waiting events found dispatching network-vif-unplugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:11:00 user nova-compute[75293]: WARNING nova.compute.manager [req-5cb33d82-76bc-4a88-92b2-38569ce267c6 req-484a5169-b79d-425e-8ba9-2ad0b09fdc9e service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received unexpected event network-vif-unplugged-59532faa-7c54-4c8f-ac5f-bea10353a48d for instance with vm_state active and task_state rescuing.
Nov 30 07:11:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG nova.network.neutron [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Updating instance_info_cache with network_info: [{"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:11:01 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Instance destroyed successfully.
Nov 30 07:11:01 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Attempting a stable device rescue
Nov 30 07:11:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Releasing lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:11:01 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Creating image(s)
Nov 30 07:11:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "/opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "/opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "/opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG nova.objects.instance [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'trusted_certs' on Instance uuid 251604ac-b300-49ae-ae1a-4543665fead6 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-62eed224-3115-4bd0-9e29-884f389fe347 req-c9a484b8-9aa6-442e-835c-94f8cda80f69 service nova] Acquired lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG nova.network.neutron [req-62eed224-3115-4bd0-9e29-884f389fe347 req-c9a484b8-9aa6-442e-835c-94f8cda80f69 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Refreshing network info cache for port 7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG nova.objects.base [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Object Instance<251604ac-b300-49ae-ae1a-4543665fead6> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75293) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Instance directory exists: not creating {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 07:11:01 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Creating image(s)
Nov 30 07:11:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "/opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "/opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG nova.objects.instance [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1b6dee8d-d419-47a3-b2be-4d15e17d6061 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "8ae123beb9d004dc85f90ee6a5d8dab96dd17598" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "8ae123beb9d004dc85f90ee6a5d8dab96dd17598" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ae123beb9d004dc85f90ee6a5d8dab96dd17598.part --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586.part --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] No waiting events found dispatching network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:11:03 user nova-compute[75293]: WARNING nova.compute.manager [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received unexpected event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d for instance with vm_state active and task_state rescuing.
Nov 30 07:11:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] No waiting events found dispatching network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:11:03 user nova-compute[75293]: WARNING nova.compute.manager [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received unexpected event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d for instance with vm_state active and task_state rescuing.
Nov 30 07:11:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] No waiting events found dispatching network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:11:03 user nova-compute[75293]: WARNING nova.compute.manager [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received unexpected event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d for instance with vm_state active and task_state rescuing.
Nov 30 07:11:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-vif-unplugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] No waiting events found dispatching network-vif-unplugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:11:03 user nova-compute[75293]: WARNING nova.compute.manager [req-60f49dd3-eb34-466b-93ed-8938c206e877 req-edc10e0c-33b0-4095-b989-f145c174c935 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received unexpected event network-vif-unplugged-59532faa-7c54-4c8f-ac5f-bea10353a48d for instance with vm_state active and task_state rescuing.
Nov 30 07:11:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ae123beb9d004dc85f90ee6a5d8dab96dd17598.part --force-share --output=json" returned: 0 in 1.211s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG nova.virt.images [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] cdcd59e9-f8ba-461a-b601-76bbde02489b was qcow2, converting to raw {{(pid=75293) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG nova.privsep.utils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75293) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8ae123beb9d004dc85f90ee6a5d8dab96dd17598.part /opt/stack/data/nova/instances/_base/8ae123beb9d004dc85f90ee6a5d8dab96dd17598.converted {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586.part --force-share --output=json" returned: 0 in 0.186s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG nova.virt.images [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] 57176440-5d28-49e2-80f6-f0422797ab9a was qcow2, converting to raw {{(pid=75293) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG nova.privsep.utils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75293) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 07:11:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586.part /opt/stack/data/nova/instances/_base/bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586.converted {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8ae123beb9d004dc85f90ee6a5d8dab96dd17598.part /opt/stack/data/nova/instances/_base/8ae123beb9d004dc85f90ee6a5d8dab96dd17598.converted" returned: 0 in 0.277s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ae123beb9d004dc85f90ee6a5d8dab96dd17598.converted --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586.part /opt/stack/data/nova/instances/_base/bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586.converted" returned: 0 in 0.287s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586.converted --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.network.neutron [req-62eed224-3115-4bd0-9e29-884f389fe347 req-c9a484b8-9aa6-442e-835c-94f8cda80f69 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Updated VIF entry in instance network info cache for port 7cf6968f-9b43-4e24-9ade-d296716616fe. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.network.neutron [req-62eed224-3115-4bd0-9e29-884f389fe347 req-c9a484b8-9aa6-442e-835c-94f8cda80f69 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Updating instance_info_cache with network_info: [{"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-62eed224-3115-4bd0-9e29-884f389fe347 req-c9a484b8-9aa6-442e-835c-94f8cda80f69 service nova] Releasing lock "refresh_cache-251604ac-b300-49ae-ae1a-4543665fead6" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ae123beb9d004dc85f90ee6a5d8dab96dd17598.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "8ae123beb9d004dc85f90ee6a5d8dab96dd17598" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.037s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "8ae123beb9d004dc85f90ee6a5d8dab96dd17598" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "8ae123beb9d004dc85f90ee6a5d8dab96dd17598" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ae123beb9d004dc85f90ee6a5d8dab96dd17598 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586.converted --force-share --output=json" returned: 0 in 0.230s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.271s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ae123beb9d004dc85f90ee6a5d8dab96dd17598 --force-share --output=json" returned: 0 in 0.207s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8ae123beb9d004dc85f90ee6a5d8dab96dd17598,backing_fmt=raw /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk.rescue {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8ae123beb9d004dc85f90ee6a5d8dab96dd17598,backing_fmt=raw /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk.rescue" returned: 0 in 0.068s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "8ae123beb9d004dc85f90ee6a5d8dab96dd17598" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.objects.instance [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lazy-loading 'migration_context' on Instance uuid 1b6dee8d-d419-47a3-b2be-4d15e17d6061 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.objects.base [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Object Instance<1b6dee8d-d419-47a3-b2be-4d15e17d6061> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Start _get_guest_xml network_info=[{"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "vif_mac": "fa:16:3e:c6:2c:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cdcd59e9-f8ba-461a-b601-76bbde02489b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qyovIDVz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '1b6dee8d-d419-47a3-b2be-4d15e17d6061', 'attached_at': '', 'detached_at': '', 'volume_id': '5d80efc0-d30e-4484-a572-3839e3e01f8d', 'serial': '5d80efc0-d30e-4484-a572-3839e3e01f8d'}, 'delete_on_termination': False, 'attachment_id': 'fa5cd200-bff9-4dae-bb94-1dcc0792de65', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.objects.instance [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lazy-loading 'resources' on Instance uuid 1b6dee8d-d419-47a3-b2be-4d15e17d6061 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.objects.base [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Object Instance<1b6dee8d-d419-47a3-b2be-4d15e17d6061> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.objects.instance [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lazy-loading 'numa_topology' on Instance uuid 1b6dee8d-d419-47a3-b2be-4d15e17d6061 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.objects.base [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Object Instance<1b6dee8d-d419-47a3-b2be-4d15e17d6061> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:11:04 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:11:04 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.objects.instance [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1b6dee8d-d419-47a3-b2be-4d15e17d6061 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586 --force-share --output=json" returned: 0 in 0.205s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.objects.base [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Object Instance<1b6dee8d-d419-47a3-b2be-4d15e17d6061> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qyovIDVz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:11:04 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:11:04 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:11:04 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0154d17-80c8-476c-9655-bcd8c69fccfa]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = qyovIDVz\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 30 07:11:04 user nova-compute[75293]: node.name = iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d
Nov 30 07:11:04 user nova-compute[75293]: node.tpgt = -1
Nov 30 07:11:04 user nova-compute[75293]: node.startup = automatic
Nov 30 07:11:04 user nova-compute[75293]: node.leading_login = No
Nov 30 07:11:04 user nova-compute[75293]: iface.iscsi_ifacename = default
Nov 30 07:11:04 user nova-compute[75293]: iface.net_ifacename = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.ipaddress = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.prefix_len = 0
Nov 30 07:11:04 user nova-compute[75293]: iface.hwaddress = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.transport_name = tcp
Nov 30 07:11:04 user nova-compute[75293]: iface.initiatorname = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.state = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.vlan_id = 0
Nov 30 07:11:04 user nova-compute[75293]: iface.vlan_priority = 0
Nov 30 07:11:04 user nova-compute[75293]: iface.vlan_state = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.iface_num = 0
Nov 30 07:11:04 user nova-compute[75293]: iface.mtu = 0
Nov 30 07:11:04 user nova-compute[75293]: iface.port = 0
Nov 30 07:11:04 user nova-compute[75293]: iface.bootproto = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.subnet_mask = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.gateway = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.dhcp_alt_client_id_state = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.dhcp_alt_client_id = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.dhcp_dns = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.dhcp_learn_iqn = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.dhcp_req_vendor_id_state = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.dhcp_vendor_id_state = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.dhcp_vendor_id = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.dhcp_slp_da = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.fragmentation = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.gratuitous_arp = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.incoming_forwarding = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.tos_state = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.tos = 0
Nov 30 07:11:04 user nova-compute[75293]: iface.ttl = 0
Nov 30 07:11:04 user nova-compute[75293]: iface.delayed_ack = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.tcp_nagle = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.tcp_wsf_state = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.tcp_wsf = 0
Nov 30 07:11:04 user nova-compute[75293]: iface.tcp_timer_scale = 0
Nov 30 07:11:04 user nova-compute[75293]: iface.tcp_timestamp = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.redirect = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.def_task_mgmt_timeout = 0
Nov 30 07:11:04 user nova-compute[75293]: iface.header_digest = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.data_digest = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.immediate_data = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.initial_r2t = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.data_seq_inorder = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.data_pdu_inorder = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.erl = 0
Nov 30 07:11:04 user nova-compute[75293]: iface.max_receive_data_len = 0
Nov 30 07:11:04 user nova-compute[75293]: iface.first_burst_len = 0
Nov 30 07:11:04 user nova-compute[75293]: iface.max_outstanding_r2t = 0
Nov 30 07:11:04 user nova-compute[75293]: iface.max_burst_len = 0
Nov 30 07:11:04 user nova-compute[75293]: iface.chap_auth = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.bidi_chap = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.strict_login_compliance = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.discovery_auth = <empty>
Nov 30 07:11:04 user nova-compute[75293]: iface.discovery_logout = <empty>
Nov 30 07:11:04 user nova-compute[75293]: node.discovery_address = <empty>
Nov 30 07:11:04 user nova-compute[75293]: node.discovery_port = 0
Nov 30 07:11:04 user nova-compute[75293]: node.discovery_type = static
Nov 30 07:11:04 user nova-compute[75293]: node.session.initial_cmdsn = 0
Nov 30 07:11:04 user nova-compute[75293]: node.session.initial_login_retry_max = 8
Nov 30 07:11:04 user nova-compute[75293]: node.session.xmit_thread_priority = -20
Nov 30 07:11:04 user nova-compute[75293]: node.session.cmds_max = 128
Nov 30 07:11:04 user nova-compute[75293]: node.session.queue_depth = 32
Nov 30 07:11:04 user nova-compute[75293]: node.session.nr_sessions = 1
Nov 30 07:11:04 user nova-compute[75293]: node.session.auth.authmethod = CHAP
Nov 30 07:11:04 user nova-compute[75293]: node.session.auth.username = qyovIDVz
Nov 30 07:11:04 user nova-compute[75293]: node.session.auth.password = ***
Nov 30 07:11:04 user nova-compute[75293]: node.session.auth.username_in = <empty>
Nov 30 07:11:04 user nova-compute[75293]: node.session.auth.password_in = <empty>
Nov 30 07:11:04 user nova-compute[75293]: node.session.auth.chap_algs = MD5
Nov 30 07:11:04 user nova-compute[75293]: node.session.timeo.replacement_timeout = 120
Nov 30 07:11:04 user nova-compute[75293]: node.session.err_timeo.abort_timeout = 15
Nov 30 07:11:04 user nova-compute[75293]: node.session.err_timeo.lu_reset_timeout = 30
Nov 30 07:11:04 user nova-compute[75293]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 30 07:11:04 user nova-compute[75293]: node.session.err_timeo.host_reset_timeout = 60
Nov 30 07:11:04 user nova-compute[75293]: node.session.iscsi.FastAbort = Yes
Nov 30 07:11:04 user nova-compute[75293]: node.session.iscsi.InitialR2T = No
Nov 30 07:11:04 user nova-compute[75293]: node.session.iscsi.ImmediateData = Yes
Nov 30 07:11:04 user nova-compute[75293]: node.session.iscsi.FirstBurstLength = 262144
Nov 30 07:11:04 user nova-compute[75293]: node.session.iscsi.MaxBurstLength = 16776192
Nov 30 07:11:04 user nova-compute[75293]: node.session.iscsi.DefaultTime2Retain = 0
Nov 30 07:11:04 user nova-compute[75293]: node.session.iscsi.DefaultTime2Wait = 2
Nov 30 07:11:04 user nova-compute[75293]: node.session.iscsi.MaxConnections = 1
Nov 30 07:11:04 user nova-compute[75293]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 30 07:11:04 user nova-compute[75293]: node.session.iscsi.ERL = 0
Nov 30 07:11:04 user nova-compute[75293]: node.session.scan = manual
Nov 30 07:11:04 user nova-compute[75293]: node.session.reopen_max = 0
Nov 30 07:11:04 user nova-compute[75293]: node.conn[0].address = 172.16.0.220
Nov 30 07:11:04 user nova-compute[75293]: node.conn[0].port = 3260
Nov 30 07:11:04 user nova-compute[75293]: node.conn[0].startup = manual
Nov 30 07:11:04 user nova-compute[75293]: node.conn[0].tcp.window_size = 524288
Nov 30 07:11:04 user nova-compute[75293]: node.conn[0].tcp.type_of_service = 0
Nov 30 07:11:04 user nova-compute[75293]: node.conn[0].timeo.logout_timeout = 15
Nov 30 07:11:04 user nova-compute[75293]: node.conn[0].timeo.login_timeout = 15
Nov 30 07:11:04 user nova-compute[75293]: node.conn[0].timeo.auth_timeout = 45
Nov 30 07:11:04 user nova-compute[75293]: node.conn[0].timeo.noop_out_interval = 5
Nov 30 07:11:04 user nova-compute[75293]: node.conn[0].timeo.noop_out_timeout = 5
Nov 30 07:11:04 user nova-compute[75293]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 30 07:11:04 user nova-compute[75293]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 30 07:11:04 user nova-compute[75293]: node.conn[0].iscsi.HeaderDigest = None
Nov 30 07:11:04 user nova-compute[75293]: node.conn[0].iscsi.DataDigest = None
Nov 30 07:11:04 user nova-compute[75293]: node.conn[0].iscsi.IFMarker = No
Nov 30 07:11:04 user nova-compute[75293]: node.conn[0].iscsi.OFMarker = No
Nov 30 07:11:04 user nova-compute[75293]: # END RECORD
Nov 30 07:11:04 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-89b6e60f-9131-49c1-b4ec-b9a168b347a8 req-01687b90-4869-45e5-88c5-6442ccf1cb89 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-89b6e60f-9131-49c1-b4ec-b9a168b347a8 req-01687b90-4869-45e5-88c5-6442ccf1cb89 service nova] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-89b6e60f-9131-49c1-b4ec-b9a168b347a8 req-01687b90-4869-45e5-88c5-6442ccf1cb89 service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-89b6e60f-9131-49c1-b4ec-b9a168b347a8 req-01687b90-4869-45e5-88c5-6442ccf1cb89 service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-89b6e60f-9131-49c1-b4ec-b9a168b347a8 req-01687b90-4869-45e5-88c5-6442ccf1cb89 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] No waiting events found dispatching network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:11:04 user nova-compute[75293]: WARNING nova.compute.manager [req-89b6e60f-9131-49c1-b4ec-b9a168b347a8 req-01687b90-4869-45e5-88c5-6442ccf1cb89 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received unexpected event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d for instance with vm_state active and task_state rescuing.
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a1e317-42a1-4619-ac60-b224076805d5]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c621044-d3d9-4d7b-a35a-bb56ede51383]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qyovIDVz {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586 --force-share --output=json" returned: 0 in 0.179s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586,backing_fmt=raw /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qyovIDVz" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[35656d93-1d0c-4e83-8f22-280bdccb4f5d]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qyovIDVz'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586,backing_fmt=raw /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk 1073741824" returned: 0 in 0.047s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e0304e-e556-45c6-9edf-8a36db11f8fb]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d23d302-bfe5-438d-85f1-84cf8794a10d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:11:04 user nova-compute[75293]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:11:04 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:11:04 user nova-compute[75293]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:11:04 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.217s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] HCTL ('34', '0', '0', 0) found on session 17 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2f0428-ed88-46f7-8b12-5fab4ed5be27]: (4, ('0 0 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Searching for a device in session 17 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qyovIDVz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.246s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] <== connect_volume: return (249ms) {'type': 'block', 'scsi_wwn': '26434353639303336', 'path': '/dev/sdc'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:11:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434353639303336', 'path': '/dev/sdc'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:11:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1726376547',display_name='tempest-ServerStableDeviceRescueTest-server-1726376547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1726376547',id=1,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2zqZqO0QK157+eSrLkJyxdVIfoBSFfpmYkPAeb8ikJKX0k4XMkh5q0M3TM7YT5CDeOyMhl/SU18f6cdJzqIgDsuiIfH9NGqE4O4Mw8kvIb2EixuK2eyb5uN/WJbVm++Q==',key_name='tempest-keypair-1570503927',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:07:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d19ade0f478e4fa09780686118f9155c',ramdisk_id='',reservation_id='r-l5vpvaom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-786185367',owner_user_name='tempest-ServerStableDeviceRescueTest-786185367-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:09:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dfa6fb751d6425f93feabaa8402cd81',uuid=1b6dee8d-d419-47a3-b2be-4d15e17d6061,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "vif_mac": "fa:16:3e:c6:2c:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:11:05 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Converting VIF {"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "vif_mac": "fa:16:3e:c6:2c:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:11:05 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=59532faa-7c54-4c8f-ac5f-bea10353a48d,network=Network(e405aa5a-b440-40a0-bec7-796676ed00a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59532faa-7c') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:11:05 user nova-compute[75293]: DEBUG nova.objects.instance [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b6dee8d-d419-47a3-b2be-4d15e17d6061 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:11:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6a6c6b9ed2d2b65aba60cc0a2d00b76b134586 --force-share --output=json" returned: 0 in 0.197s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:05 user nova-compute[75293]: DEBUG nova.objects.instance [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'migration_context' on Instance uuid 251604ac-b300-49ae-ae1a-4543665fead6 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:11:05 user nova-compute[75293]: DEBUG nova.objects.base [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Object Instance<1b6dee8d-d419-47a3-b2be-4d15e17d6061> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:11:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:11:05 user nova-compute[75293]:   <uuid>1b6dee8d-d419-47a3-b2be-4d15e17d6061</uuid>
Nov 30 07:11:05 user nova-compute[75293]:   <name>instance-00000001</name>
Nov 30 07:11:05 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:11:05 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:11:05 user nova-compute[75293]:   <metadata>
Nov 30 07:11:05 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:11:05 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:11:05 user nova-compute[75293]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1726376547</nova:name>
Nov 30 07:11:05 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:11:04</nova:creationTime>
Nov 30 07:11:05 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:11:05 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:11:05 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:11:05 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:11:05 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:11:05 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:11:05 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:11:05 user nova-compute[75293]:       <nova:owner>
Nov 30 07:11:05 user nova-compute[75293]:         <nova:user uuid="8dfa6fb751d6425f93feabaa8402cd81">tempest-ServerStableDeviceRescueTest-786185367-project-member</nova:user>
Nov 30 07:11:05 user nova-compute[75293]:         <nova:project uuid="d19ade0f478e4fa09780686118f9155c">tempest-ServerStableDeviceRescueTest-786185367</nova:project>
Nov 30 07:11:05 user nova-compute[75293]:       </nova:owner>
Nov 30 07:11:05 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:11:05 user nova-compute[75293]:       <nova:ports>
Nov 30 07:11:05 user nova-compute[75293]:         <nova:port uuid="59532faa-7c54-4c8f-ac5f-bea10353a48d">
Nov 30 07:11:05 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 07:11:05 user nova-compute[75293]:         </nova:port>
Nov 30 07:11:05 user nova-compute[75293]:       </nova:ports>
Nov 30 07:11:05 user nova-compute[75293]:     </nova:instance>
Nov 30 07:11:05 user nova-compute[75293]:   </metadata>
Nov 30 07:11:05 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:11:05 user nova-compute[75293]:     <system>
Nov 30 07:11:05 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:11:05 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:11:05 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:11:05 user nova-compute[75293]:       <entry name="serial">1b6dee8d-d419-47a3-b2be-4d15e17d6061</entry>
Nov 30 07:11:05 user nova-compute[75293]:       <entry name="uuid">1b6dee8d-d419-47a3-b2be-4d15e17d6061</entry>
Nov 30 07:11:05 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:11:05 user nova-compute[75293]:     </system>
Nov 30 07:11:05 user nova-compute[75293]:   </sysinfo>
Nov 30 07:11:05 user nova-compute[75293]:   <os>
Nov 30 07:11:05 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:11:05 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:11:05 user nova-compute[75293]:   </os>
Nov 30 07:11:05 user nova-compute[75293]:   <features>
Nov 30 07:11:05 user nova-compute[75293]:     <acpi/>
Nov 30 07:11:05 user nova-compute[75293]:     <apic/>
Nov 30 07:11:05 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:11:05 user nova-compute[75293]:   </features>
Nov 30 07:11:05 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:11:05 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:11:05 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:11:05 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:11:05 user nova-compute[75293]:   </clock>
Nov 30 07:11:05 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:11:05 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:11:05 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:11:05 user nova-compute[75293]:   </cpu>
Nov 30 07:11:05 user nova-compute[75293]:   <devices>
Nov 30 07:11:05 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:11:05 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:11:05 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk"/>
Nov 30 07:11:05 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:11:05 user nova-compute[75293]:     </disk>
Nov 30 07:11:05 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:11:05 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:11:05 user nova-compute[75293]:       <source dev="/dev/sdc"/>
Nov 30 07:11:05 user nova-compute[75293]:       <target dev="vdb" bus="virtio"/>
Nov 30 07:11:05 user nova-compute[75293]:       <serial>5d80efc0-d30e-4484-a572-3839e3e01f8d</serial>
Nov 30 07:11:05 user nova-compute[75293]:     </disk>
Nov 30 07:11:05 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:11:05 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:11:05 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk.rescue"/>
Nov 30 07:11:05 user nova-compute[75293]:       <target dev="vdc" bus="virtio"/>
Nov 30 07:11:05 user nova-compute[75293]:       <boot order="1"/>
Nov 30 07:11:05 user nova-compute[75293]:     </disk>
Nov 30 07:11:05 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:11:05 user nova-compute[75293]:       <mac address="fa:16:3e:c6:2c:81"/>
Nov 30 07:11:05 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:11:05 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:11:05 user nova-compute[75293]:       <target dev="tap59532faa-7c"/>
Nov 30 07:11:05 user nova-compute[75293]:     </interface>
Nov 30 07:11:05 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:11:05 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/console.log" append="off"/>
Nov 30 07:11:05 user nova-compute[75293]:     </serial>
Nov 30 07:11:05 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:11:05 user nova-compute[75293]:     <video>
Nov 30 07:11:05 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:11:05 user nova-compute[75293]:     </video>
Nov 30 07:11:05 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:11:05 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:11:05 user nova-compute[75293]:     </rng>
Nov 30 07:11:05 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:11:05 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:11:05 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:11:05 user nova-compute[75293]:     </memballoon>
Nov 30 07:11:05 user nova-compute[75293]:   </devices>
Nov 30 07:11:05 user nova-compute[75293]: </domain>
Nov 30 07:11:05 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:11:05 user nova-compute[75293]: DEBUG nova.objects.base [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Object Instance<251604ac-b300-49ae-ae1a-4543665fead6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:11:05 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Rebasing disk image.
Nov 30 07:11:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:05 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Instance destroyed successfully.
Nov 30 07:11:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:11:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:11:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:11:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] No VIF found with MAC fa:16:3e:c6:2c:81, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:11:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.265s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 -F raw /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:07 user nova-compute[75293]: DEBUG nova.compute.manager [req-188f4cd3-5bc7-4f8f-81af-01bb1d63fb76 req-1c60f918-da5f-4d14-b2c0-1910a3d74a7a service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:11:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-188f4cd3-5bc7-4f8f-81af-01bb1d63fb76 req-1c60f918-da5f-4d14-b2c0-1910a3d74a7a service nova] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-188f4cd3-5bc7-4f8f-81af-01bb1d63fb76 req-1c60f918-da5f-4d14-b2c0-1910a3d74a7a service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-188f4cd3-5bc7-4f8f-81af-01bb1d63fb76 req-1c60f918-da5f-4d14-b2c0-1910a3d74a7a service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:07 user nova-compute[75293]: DEBUG nova.compute.manager [req-188f4cd3-5bc7-4f8f-81af-01bb1d63fb76 req-1c60f918-da5f-4d14-b2c0-1910a3d74a7a service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] No waiting events found dispatching network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:11:07 user nova-compute[75293]: WARNING nova.compute.manager [req-188f4cd3-5bc7-4f8f-81af-01bb1d63fb76 req-1c60f918-da5f-4d14-b2c0-1910a3d74a7a service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received unexpected event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d for instance with vm_state active and task_state rescuing.
Nov 30 07:11:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 -F raw /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk" returned: 0 in 2.855s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Ensure instance console log exists: /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Start _get_guest_xml network_info=[{"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='dab07c35c382e373ec9ce5a5afdf8cc9',container_format='bare',created_at=2023-11-30T07:08:54Z,direct_url=<?>,disk_format='qcow2',id=57176440-5d28-49e2-80f6-f0422797ab9a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1720061760-shelved',owner='18aa2f5bea3d44ecb10ff083d6f76038',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-30T07:08:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUwBmTQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '251604ac-b300-49ae-ae1a-4543665fead6', 'attached_at': '', 'detached_at': '', 'volume_id': '1fd4498f-6a27-4f34-90e3-e80f4a1d16db', 'serial': '1fd4498f-6a27-4f34-90e3-e80f4a1d16db'}, 'delete_on_termination': False, 'attachment_id': 'e097ed67-afb0-47da-9a58-a78417cc582c', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:11:08 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:11:08 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='dab07c35c382e373ec9ce5a5afdf8cc9',container_format='bare',created_at=2023-11-30T07:08:54Z,direct_url=<?>,disk_format='qcow2',id=57176440-5d28-49e2-80f6-f0422797ab9a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1720061760-shelved',owner='18aa2f5bea3d44ecb10ff083d6f76038',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-30T07:08:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.objects.instance [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'vcpu_model' on Instance uuid 251604ac-b300-49ae-ae1a-4543665fead6 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.objects.base [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Object Instance<251604ac-b300-49ae-ae1a-4543665fead6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUwBmTQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:11:08 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:11:08 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:11:08 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[37700c2a-1ecd-4602-a8de-40df218dc56f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:11:08 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4b8935-04db-41be-a2ec-e6ed4ca7b76d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db] added
Nov 30 07:11:08 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0a6b56-75f8-49a8-80df-d344bfe8b481]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8a1888-e6e5-4490-a238-f5f045933186]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUwBmTQO {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUwBmTQO" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[866a5a6e-d8c8-4572-8be8-4a423a1ce2c2]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cUwBmTQO'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5023790e-5d98-45b5-8b5f-ffce0e91253f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b328bbbe-5e9c-4a0d-9d7b-9c0acb7cbc56]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:11:08 user nova-compute[75293]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:11:08 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:11:08 user nova-compute[75293]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:11:08 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bcadd2-daa6-4757-82e1-d1ea4cef5b47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db, portal: 172.16.0.220,3260]
Nov 30 07:11:08 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db, portal: 172.16.0.220,3260] successful.
Nov 30 07:11:08 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cf19f2-91b9-43bd-b5e4-a7253bc1593f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8061eff-117e-4348-a747-7fa9bd1f0c85]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:11:08 user nova-compute[75293]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:11:08 user nova-compute[75293]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db (non-flash)
Nov 30 07:11:08 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:11:08 user nova-compute[75293]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:11:08 user nova-compute[75293]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db (non-flash)
Nov 30 07:11:08 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[262e7096-ec01-4991-92c4-5a4f754c2d3c]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:11:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUwBmTQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG nova.compute.manager [req-dfe50c4a-a700-4fdf-a025-dc7c0e5f4592 req-8b9903c2-9333-4052-a915-75a4b7af468f service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-dfe50c4a-a700-4fdf-a025-dc7c0e5f4592 req-8b9903c2-9333-4052-a915-75a4b7af468f service nova] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-dfe50c4a-a700-4fdf-a025-dc7c0e5f4592 req-8b9903c2-9333-4052-a915-75a4b7af468f service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-dfe50c4a-a700-4fdf-a025-dc7c0e5f4592 req-8b9903c2-9333-4052-a915-75a4b7af468f service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG nova.compute.manager [req-dfe50c4a-a700-4fdf-a025-dc7c0e5f4592 req-8b9903c2-9333-4052-a915-75a4b7af468f service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] No waiting events found dispatching network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:11:09 user nova-compute[75293]: WARNING nova.compute.manager [req-dfe50c4a-a700-4fdf-a025-dc7c0e5f4592 req-8b9903c2-9333-4052-a915-75a4b7af468f service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received unexpected event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d for instance with vm_state active and task_state rescuing.
Nov 30 07:11:09 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '26233623764383336', 'path': '/dev/sdd'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233623764383336', 'path': '/dev/sdd'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T07:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1720061760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1720061760',id=3,image_ref='57176440-5d28-49e2-80f6-f0422797ab9a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-466117858',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:07:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='18aa2f5bea3d44ecb10ff083d6f76038',ramdisk_id='',reservation_id='r-8g0ngsgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-763079906',owner_user_name='tempest-AttachVolumeShelveTestJSON-763079906-project-member',shelved_at='2023-11-30T07:08:59.568664',shelved_host='user',shelved_image_id='57176440-5d28-49e2-80f6-f0422797ab9a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:10:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e385a89f913645dd9fd2770e6e7445da',uuid=251604ac-b300-49ae-ae1a-4543665fead6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converting VIF {"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=7cf6968f-9b43-4e24-9ade-d296716616fe,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf6968f-9b') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG nova.objects.instance [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'pci_devices' on Instance uuid 251604ac-b300-49ae-ae1a-4543665fead6 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG nova.compute.manager [None req-514c366f-d774-4ee8-957c-e99ee044d49a tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG nova.objects.base [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Object Instance<251604ac-b300-49ae-ae1a-4543665fead6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:11:09 user nova-compute[75293]:   <uuid>251604ac-b300-49ae-ae1a-4543665fead6</uuid>
Nov 30 07:11:09 user nova-compute[75293]:   <name>instance-00000003</name>
Nov 30 07:11:09 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:11:09 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:11:09 user nova-compute[75293]:   <metadata>
Nov 30 07:11:09 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:11:09 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:11:09 user nova-compute[75293]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1720061760</nova:name>
Nov 30 07:11:09 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:11:08</nova:creationTime>
Nov 30 07:11:09 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:11:09 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:11:09 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:11:09 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:11:09 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:11:09 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:11:09 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:11:09 user nova-compute[75293]:       <nova:owner>
Nov 30 07:11:09 user nova-compute[75293]:         <nova:user uuid="e385a89f913645dd9fd2770e6e7445da">tempest-AttachVolumeShelveTestJSON-763079906-project-member</nova:user>
Nov 30 07:11:09 user nova-compute[75293]:         <nova:project uuid="18aa2f5bea3d44ecb10ff083d6f76038">tempest-AttachVolumeShelveTestJSON-763079906</nova:project>
Nov 30 07:11:09 user nova-compute[75293]:       </nova:owner>
Nov 30 07:11:09 user nova-compute[75293]:       <nova:root type="image" uuid="57176440-5d28-49e2-80f6-f0422797ab9a"/>
Nov 30 07:11:09 user nova-compute[75293]:       <nova:ports>
Nov 30 07:11:09 user nova-compute[75293]:         <nova:port uuid="7cf6968f-9b43-4e24-9ade-d296716616fe">
Nov 30 07:11:09 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 07:11:09 user nova-compute[75293]:         </nova:port>
Nov 30 07:11:09 user nova-compute[75293]:       </nova:ports>
Nov 30 07:11:09 user nova-compute[75293]:     </nova:instance>
Nov 30 07:11:09 user nova-compute[75293]:   </metadata>
Nov 30 07:11:09 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:11:09 user nova-compute[75293]:     <system>
Nov 30 07:11:09 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:11:09 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:11:09 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:11:09 user nova-compute[75293]:       <entry name="serial">251604ac-b300-49ae-ae1a-4543665fead6</entry>
Nov 30 07:11:09 user nova-compute[75293]:       <entry name="uuid">251604ac-b300-49ae-ae1a-4543665fead6</entry>
Nov 30 07:11:09 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:11:09 user nova-compute[75293]:     </system>
Nov 30 07:11:09 user nova-compute[75293]:   </sysinfo>
Nov 30 07:11:09 user nova-compute[75293]:   <os>
Nov 30 07:11:09 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:11:09 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:11:09 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:11:09 user nova-compute[75293]:   </os>
Nov 30 07:11:09 user nova-compute[75293]:   <features>
Nov 30 07:11:09 user nova-compute[75293]:     <acpi/>
Nov 30 07:11:09 user nova-compute[75293]:     <apic/>
Nov 30 07:11:09 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:11:09 user nova-compute[75293]:   </features>
Nov 30 07:11:09 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:11:09 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:11:09 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:11:09 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:11:09 user nova-compute[75293]:   </clock>
Nov 30 07:11:09 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:11:09 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:11:09 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:11:09 user nova-compute[75293]:   </cpu>
Nov 30 07:11:09 user nova-compute[75293]:   <devices>
Nov 30 07:11:09 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:11:09 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:11:09 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk"/>
Nov 30 07:11:09 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:11:09 user nova-compute[75293]:     </disk>
Nov 30 07:11:09 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:11:09 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:11:09 user nova-compute[75293]:       <source dev="/dev/sdd"/>
Nov 30 07:11:09 user nova-compute[75293]:       <target dev="vdc" bus="virtio"/>
Nov 30 07:11:09 user nova-compute[75293]:       <serial>1fd4498f-6a27-4f34-90e3-e80f4a1d16db</serial>
Nov 30 07:11:09 user nova-compute[75293]:     </disk>
Nov 30 07:11:09 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:11:09 user nova-compute[75293]:       <mac address="fa:16:3e:1e:ec:42"/>
Nov 30 07:11:09 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:11:09 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:11:09 user nova-compute[75293]:       <target dev="tap7cf6968f-9b"/>
Nov 30 07:11:09 user nova-compute[75293]:     </interface>
Nov 30 07:11:09 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:11:09 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/console.log" append="off"/>
Nov 30 07:11:09 user nova-compute[75293]:     </serial>
Nov 30 07:11:09 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:11:09 user nova-compute[75293]:     <video>
Nov 30 07:11:09 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:11:09 user nova-compute[75293]:     </video>
Nov 30 07:11:09 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:11:09 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:11:09 user nova-compute[75293]:     </rng>
Nov 30 07:11:09 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:11:09 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:11:09 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:11:09 user nova-compute[75293]:     </memballoon>
Nov 30 07:11:09 user nova-compute[75293]:   </devices>
Nov 30 07:11:09 user nova-compute[75293]: </domain>
Nov 30 07:11:09 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T07:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1720061760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1720061760',id=3,image_ref='57176440-5d28-49e2-80f6-f0422797ab9a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-466117858',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:07:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='18aa2f5bea3d44ecb10ff083d6f76038',ramdisk_id='',reservation_id='r-8g0ngsgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-763079906',owner_user_name='tempest-AttachVolumeShelveTestJSON-763079906-project-member',shelved_at='2023-11-30T07:08:59.568664',shelved_host='user',shelved_image_id='57176440-5d28-49e2-80f6-f0422797ab9a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:10:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e385a89f913645dd9fd2770e6e7445da',uuid=251604ac-b300-49ae-ae1a-4543665fead6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converting VIF {"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=7cf6968f-9b43-4e24-9ade-d296716616fe,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf6968f-9b') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG os_vif [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=7cf6968f-9b43-4e24-9ade-d296716616fe,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf6968f-9b') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '506617f2-9c8c-548b-9624-7b6f50463c95', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cf6968f-9b, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cf6968f-9b, col_values=(('qos', UUID('2831c75e-3a3e-4aec-8638-63caae0fa514')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cf6968f-9b, col_values=(('external_ids', {'iface-id': '7cf6968f-9b43-4e24-9ade-d296716616fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:ec:42', 'vm-uuid': '251604ac-b300-49ae-ae1a-4543665fead6'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:09 user nova-compute[75293]: INFO os_vif [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=7cf6968f-9b43-4e24-9ade-d296716616fe,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf6968f-9b')
Nov 30 07:11:09 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:11:09 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] No VIF found with MAC fa:16:3e:1e:ec:42, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:11:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-c00907cb-3a95-4b45-b8a5-323c4263e5c0 req-0ddfffa9-7ecf-4c8b-b3c6-fdec9e425a56 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received event network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:11:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c00907cb-3a95-4b45-b8a5-323c4263e5c0 req-0ddfffa9-7ecf-4c8b-b3c6-fdec9e425a56 service nova] Acquiring lock "251604ac-b300-49ae-ae1a-4543665fead6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c00907cb-3a95-4b45-b8a5-323c4263e5c0 req-0ddfffa9-7ecf-4c8b-b3c6-fdec9e425a56 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c00907cb-3a95-4b45-b8a5-323c4263e5c0 req-0ddfffa9-7ecf-4c8b-b3c6-fdec9e425a56 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-c00907cb-3a95-4b45-b8a5-323c4263e5c0 req-0ddfffa9-7ecf-4c8b-b3c6-fdec9e425a56 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] No waiting events found dispatching network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:11:11 user nova-compute[75293]: WARNING nova.compute.manager [req-c00907cb-3a95-4b45-b8a5-323c4263e5c0 req-0ddfffa9-7ecf-4c8b-b3c6-fdec9e425a56 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received unexpected event network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 07:11:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:13 user nova-compute[75293]: DEBUG nova.compute.manager [req-f37ee1d6-8c15-496c-84d3-87959f411118 req-289bb63f-3ab0-4b46-9396-f7f481f63300 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received event network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:11:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f37ee1d6-8c15-496c-84d3-87959f411118 req-289bb63f-3ab0-4b46-9396-f7f481f63300 service nova] Acquiring lock "251604ac-b300-49ae-ae1a-4543665fead6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f37ee1d6-8c15-496c-84d3-87959f411118 req-289bb63f-3ab0-4b46-9396-f7f481f63300 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f37ee1d6-8c15-496c-84d3-87959f411118 req-289bb63f-3ab0-4b46-9396-f7f481f63300 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:13 user nova-compute[75293]: DEBUG nova.compute.manager [req-f37ee1d6-8c15-496c-84d3-87959f411118 req-289bb63f-3ab0-4b46-9396-f7f481f63300 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] No waiting events found dispatching network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:11:13 user nova-compute[75293]: WARNING nova.compute.manager [req-f37ee1d6-8c15-496c-84d3-87959f411118 req-289bb63f-3ab0-4b46-9396-f7f481f63300 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received unexpected event network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 07:11:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:14 user nova-compute[75293]: DEBUG nova.compute.manager [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:11:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:11:14 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Instance spawned successfully.
Nov 30 07:11:14 user nova-compute[75293]: DEBUG nova.compute.manager [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:11:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9dd6664d-94db-40a1-8cb1-681e5eb12e5d tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "251604ac-b300-49ae-ae1a-4543665fead6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.119s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Acquiring lock "e7b31625-f927-4e52-83d6-93cbc81d6c80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "e7b31625-f927-4e52-83d6-93cbc81d6c80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:48 user nova-compute[75293]: DEBUG nova.compute.manager [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:11:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:48 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:11:48 user nova-compute[75293]: INFO nova.compute.claims [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Claim successful on node user
Nov 30 07:11:48 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:11:48 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:11:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:48 user nova-compute[75293]: DEBUG nova.compute.manager [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:11:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:48 user nova-compute[75293]: DEBUG nova.compute.manager [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:11:48 user nova-compute[75293]: DEBUG nova.network.neutron [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:11:48 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:11:48 user nova-compute[75293]: DEBUG nova.compute.manager [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:11:48 user nova-compute[75293]: DEBUG nova.policy [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e39fb27fce54653a80942b11407b3d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2a531931f94fb491608b4bd3251e7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:11:49 user nova-compute[75293]: DEBUG nova.compute.manager [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:11:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:11:49 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Creating image(s)
Nov 30 07:11:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "/opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "/opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.254s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.234s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk 1073741824" returned: 0 in 0.058s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:49 user nova-compute[75293]: DEBUG nova.network.neutron [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Successfully created port: 4613d21e-e71c-41e4-a386-adba5c84c717 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:11:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.231s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:49 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:11:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:11:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:11:50 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Cannot resize image /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:11:50 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:11:50 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Ensure instance console log exists: /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:11:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:50 user nova-compute[75293]: DEBUG nova.network.neutron [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Successfully updated port: 4613d21e-e71c-41e4-a386-adba5c84c717 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:11:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Acquiring lock "refresh_cache-e7b31625-f927-4e52-83d6-93cbc81d6c80" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:11:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Acquired lock "refresh_cache-e7b31625-f927-4e52-83d6-93cbc81d6c80" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:11:50 user nova-compute[75293]: DEBUG nova.network.neutron [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:11:50 user nova-compute[75293]: DEBUG nova.compute.manager [req-de64bb1a-ca55-48a7-a11b-cb93bd1fbd79 req-da129ee7-d9ba-4595-9436-0a4e355dab48 service nova] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Received event network-changed-4613d21e-e71c-41e4-a386-adba5c84c717 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:11:50 user nova-compute[75293]: DEBUG nova.compute.manager [req-de64bb1a-ca55-48a7-a11b-cb93bd1fbd79 req-da129ee7-d9ba-4595-9436-0a4e355dab48 service nova] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Refreshing instance network info cache due to event network-changed-4613d21e-e71c-41e4-a386-adba5c84c717. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:11:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-de64bb1a-ca55-48a7-a11b-cb93bd1fbd79 req-da129ee7-d9ba-4595-9436-0a4e355dab48 service nova] Acquiring lock "refresh_cache-e7b31625-f927-4e52-83d6-93cbc81d6c80" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.network.neutron [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.network.neutron [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Updating instance_info_cache with network_info: [{"id": "4613d21e-e71c-41e4-a386-adba5c84c717", "address": "fa:16:3e:1b:a2:50", "network": {"id": "e86d6458-aba9-4a8c-bec8-f2c68384b848", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1143901742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2a531931f94fb491608b4bd3251e7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4613d21e-e7", "ovs_interfaceid": "4613d21e-e71c-41e4-a386-adba5c84c717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Releasing lock "refresh_cache-e7b31625-f927-4e52-83d6-93cbc81d6c80" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.compute.manager [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Instance network_info: |[{"id": "4613d21e-e71c-41e4-a386-adba5c84c717", "address": "fa:16:3e:1b:a2:50", "network": {"id": "e86d6458-aba9-4a8c-bec8-f2c68384b848", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1143901742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2a531931f94fb491608b4bd3251e7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4613d21e-e7", "ovs_interfaceid": "4613d21e-e71c-41e4-a386-adba5c84c717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-de64bb1a-ca55-48a7-a11b-cb93bd1fbd79 req-da129ee7-d9ba-4595-9436-0a4e355dab48 service nova] Acquired lock "refresh_cache-e7b31625-f927-4e52-83d6-93cbc81d6c80" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.network.neutron [req-de64bb1a-ca55-48a7-a11b-cb93bd1fbd79 req-da129ee7-d9ba-4595-9436-0a4e355dab48 service nova] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Refreshing network info cache for port 4613d21e-e71c-41e4-a386-adba5c84c717 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Start _get_guest_xml network_info=[{"id": "4613d21e-e71c-41e4-a386-adba5c84c717", "address": "fa:16:3e:1b:a2:50", "network": {"id": "e86d6458-aba9-4a8c-bec8-f2c68384b848", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1143901742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2a531931f94fb491608b4bd3251e7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4613d21e-e7", "ovs_interfaceid": "4613d21e-e71c-41e4-a386-adba5c84c717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:11:51 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:11:51 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-175661468',display_name='tempest-DeleteServersTestJSON-server-175661468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-175661468',id=15,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa2a531931f94fb491608b4bd3251e7a',ramdisk_id='',reservation_id='r-9spyy1so',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-492841832',owner_user_name='tempest-DeleteServersTestJSON-492841832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:11:49Z,user_data=None,user_id='7e39fb27fce54653a80942b11407b3d0',uuid=e7b31625-f927-4e52-83d6-93cbc81d6c80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4613d21e-e71c-41e4-a386-adba5c84c717", "address": "fa:16:3e:1b:a2:50", "network": {"id": "e86d6458-aba9-4a8c-bec8-f2c68384b848", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1143901742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2a531931f94fb491608b4bd3251e7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4613d21e-e7", "ovs_interfaceid": "4613d21e-e71c-41e4-a386-adba5c84c717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Converting VIF {"id": "4613d21e-e71c-41e4-a386-adba5c84c717", "address": "fa:16:3e:1b:a2:50", "network": {"id": "e86d6458-aba9-4a8c-bec8-f2c68384b848", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1143901742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2a531931f94fb491608b4bd3251e7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4613d21e-e7", "ovs_interfaceid": "4613d21e-e71c-41e4-a386-adba5c84c717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a2:50,bridge_name='br-int',has_traffic_filtering=True,id=4613d21e-e71c-41e4-a386-adba5c84c717,network=Network(e86d6458-aba9-4a8c-bec8-f2c68384b848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4613d21e-e7') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.objects.instance [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lazy-loading 'pci_devices' on Instance uuid e7b31625-f927-4e52-83d6-93cbc81d6c80 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:11:51 user nova-compute[75293]:   <uuid>e7b31625-f927-4e52-83d6-93cbc81d6c80</uuid>
Nov 30 07:11:51 user nova-compute[75293]:   <name>instance-0000000f</name>
Nov 30 07:11:51 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:11:51 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:11:51 user nova-compute[75293]:   <metadata>
Nov 30 07:11:51 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:11:51 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:11:51 user nova-compute[75293]:       <nova:name>tempest-DeleteServersTestJSON-server-175661468</nova:name>
Nov 30 07:11:51 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:11:51</nova:creationTime>
Nov 30 07:11:51 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:11:51 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:11:51 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:11:51 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:11:51 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:11:51 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:11:51 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:11:51 user nova-compute[75293]:       <nova:owner>
Nov 30 07:11:51 user nova-compute[75293]:         <nova:user uuid="7e39fb27fce54653a80942b11407b3d0">tempest-DeleteServersTestJSON-492841832-project-member</nova:user>
Nov 30 07:11:51 user nova-compute[75293]:         <nova:project uuid="fa2a531931f94fb491608b4bd3251e7a">tempest-DeleteServersTestJSON-492841832</nova:project>
Nov 30 07:11:51 user nova-compute[75293]:       </nova:owner>
Nov 30 07:11:51 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:11:51 user nova-compute[75293]:       <nova:ports>
Nov 30 07:11:51 user nova-compute[75293]:         <nova:port uuid="4613d21e-e71c-41e4-a386-adba5c84c717">
Nov 30 07:11:51 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 07:11:51 user nova-compute[75293]:         </nova:port>
Nov 30 07:11:51 user nova-compute[75293]:       </nova:ports>
Nov 30 07:11:51 user nova-compute[75293]:     </nova:instance>
Nov 30 07:11:51 user nova-compute[75293]:   </metadata>
Nov 30 07:11:51 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:11:51 user nova-compute[75293]:     <system>
Nov 30 07:11:51 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:11:51 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:11:51 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:11:51 user nova-compute[75293]:       <entry name="serial">e7b31625-f927-4e52-83d6-93cbc81d6c80</entry>
Nov 30 07:11:51 user nova-compute[75293]:       <entry name="uuid">e7b31625-f927-4e52-83d6-93cbc81d6c80</entry>
Nov 30 07:11:51 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:11:51 user nova-compute[75293]:     </system>
Nov 30 07:11:51 user nova-compute[75293]:   </sysinfo>
Nov 30 07:11:51 user nova-compute[75293]:   <os>
Nov 30 07:11:51 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:11:51 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:11:51 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:11:51 user nova-compute[75293]:   </os>
Nov 30 07:11:51 user nova-compute[75293]:   <features>
Nov 30 07:11:51 user nova-compute[75293]:     <acpi/>
Nov 30 07:11:51 user nova-compute[75293]:     <apic/>
Nov 30 07:11:51 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:11:51 user nova-compute[75293]:   </features>
Nov 30 07:11:51 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:11:51 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:11:51 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:11:51 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:11:51 user nova-compute[75293]:   </clock>
Nov 30 07:11:51 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:11:51 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:11:51 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:11:51 user nova-compute[75293]:   </cpu>
Nov 30 07:11:51 user nova-compute[75293]:   <devices>
Nov 30 07:11:51 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:11:51 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:11:51 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk"/>
Nov 30 07:11:51 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:11:51 user nova-compute[75293]:     </disk>
Nov 30 07:11:51 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:11:51 user nova-compute[75293]:       <mac address="fa:16:3e:1b:a2:50"/>
Nov 30 07:11:51 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:11:51 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:11:51 user nova-compute[75293]:       <target dev="tap4613d21e-e7"/>
Nov 30 07:11:51 user nova-compute[75293]:     </interface>
Nov 30 07:11:51 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:11:51 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/console.log" append="off"/>
Nov 30 07:11:51 user nova-compute[75293]:     </serial>
Nov 30 07:11:51 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:11:51 user nova-compute[75293]:     <video>
Nov 30 07:11:51 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:11:51 user nova-compute[75293]:     </video>
Nov 30 07:11:51 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:11:51 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:11:51 user nova-compute[75293]:     </rng>
Nov 30 07:11:51 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:11:51 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:11:51 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:11:51 user nova-compute[75293]:     </memballoon>
Nov 30 07:11:51 user nova-compute[75293]:   </devices>
Nov 30 07:11:51 user nova-compute[75293]: </domain>
Nov 30 07:11:51 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-175661468',display_name='tempest-DeleteServersTestJSON-server-175661468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-175661468',id=15,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa2a531931f94fb491608b4bd3251e7a',ramdisk_id='',reservation_id='r-9spyy1so',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-492841832',owner_user_name='tempest-DeleteServersTestJSON-492841832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:11:49Z,user_data=None,user_id='7e39fb27fce54653a80942b11407b3d0',uuid=e7b31625-f927-4e52-83d6-93cbc81d6c80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4613d21e-e71c-41e4-a386-adba5c84c717", "address": "fa:16:3e:1b:a2:50", "network": {"id": "e86d6458-aba9-4a8c-bec8-f2c68384b848", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1143901742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2a531931f94fb491608b4bd3251e7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4613d21e-e7", "ovs_interfaceid": "4613d21e-e71c-41e4-a386-adba5c84c717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Converting VIF {"id": "4613d21e-e71c-41e4-a386-adba5c84c717", "address": "fa:16:3e:1b:a2:50", "network": {"id": "e86d6458-aba9-4a8c-bec8-f2c68384b848", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1143901742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2a531931f94fb491608b4bd3251e7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4613d21e-e7", "ovs_interfaceid": "4613d21e-e71c-41e4-a386-adba5c84c717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a2:50,bridge_name='br-int',has_traffic_filtering=True,id=4613d21e-e71c-41e4-a386-adba5c84c717,network=Network(e86d6458-aba9-4a8c-bec8-f2c68384b848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4613d21e-e7') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG os_vif [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a2:50,bridge_name='br-int',has_traffic_filtering=True,id=4613d21e-e71c-41e4-a386-adba5c84c717,network=Network(e86d6458-aba9-4a8c-bec8-f2c68384b848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4613d21e-e7') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db08db0f-1e46-5349-992c-0f9b6bd92dd4', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4613d21e-e7, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4613d21e-e7, col_values=(('qos', UUID('d0ed905c-8e42-4640-9c12-17cbb154abef')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4613d21e-e7, col_values=(('external_ids', {'iface-id': '4613d21e-e71c-41e4-a386-adba5c84c717', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:a2:50', 'vm-uuid': 'e7b31625-f927-4e52-83d6-93cbc81d6c80'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:51 user nova-compute[75293]: INFO os_vif [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a2:50,bridge_name='br-int',has_traffic_filtering=True,id=4613d21e-e71c-41e4-a386-adba5c84c717,network=Network(e86d6458-aba9-4a8c-bec8-f2c68384b848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4613d21e-e7')
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] No VIF found with MAC fa:16:3e:1b:a2:50, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.network.neutron [req-de64bb1a-ca55-48a7-a11b-cb93bd1fbd79 req-da129ee7-d9ba-4595-9436-0a4e355dab48 service nova] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Updated VIF entry in instance network info cache for port 4613d21e-e71c-41e4-a386-adba5c84c717. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:11:51 user nova-compute[75293]: DEBUG nova.network.neutron [req-de64bb1a-ca55-48a7-a11b-cb93bd1fbd79 req-da129ee7-d9ba-4595-9436-0a4e355dab48 service nova] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Updating instance_info_cache with network_info: [{"id": "4613d21e-e71c-41e4-a386-adba5c84c717", "address": "fa:16:3e:1b:a2:50", "network": {"id": "e86d6458-aba9-4a8c-bec8-f2c68384b848", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1143901742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2a531931f94fb491608b4bd3251e7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4613d21e-e7", "ovs_interfaceid": "4613d21e-e71c-41e4-a386-adba5c84c717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:11:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-de64bb1a-ca55-48a7-a11b-cb93bd1fbd79 req-da129ee7-d9ba-4595-9436-0a4e355dab48 service nova] Releasing lock "refresh_cache-e7b31625-f927-4e52-83d6-93cbc81d6c80" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:11:52 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:53 user nova-compute[75293]: DEBUG nova.compute.manager [req-0ec2b996-44a4-4062-b2de-4870251b3c9d req-f7da2524-bbf2-4294-b43f-8a8230bead1c service nova] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Received event network-vif-plugged-4613d21e-e71c-41e4-a386-adba5c84c717 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:11:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0ec2b996-44a4-4062-b2de-4870251b3c9d req-f7da2524-bbf2-4294-b43f-8a8230bead1c service nova] Acquiring lock "e7b31625-f927-4e52-83d6-93cbc81d6c80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0ec2b996-44a4-4062-b2de-4870251b3c9d req-f7da2524-bbf2-4294-b43f-8a8230bead1c service nova] Lock "e7b31625-f927-4e52-83d6-93cbc81d6c80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0ec2b996-44a4-4062-b2de-4870251b3c9d req-f7da2524-bbf2-4294-b43f-8a8230bead1c service nova] Lock "e7b31625-f927-4e52-83d6-93cbc81d6c80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:53 user nova-compute[75293]: DEBUG nova.compute.manager [req-0ec2b996-44a4-4062-b2de-4870251b3c9d req-f7da2524-bbf2-4294-b43f-8a8230bead1c service nova] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] No waiting events found dispatching network-vif-plugged-4613d21e-e71c-41e4-a386-adba5c84c717 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:11:53 user nova-compute[75293]: WARNING nova.compute.manager [req-0ec2b996-44a4-4062-b2de-4870251b3c9d req-f7da2524-bbf2-4294-b43f-8a8230bead1c service nova] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Received unexpected event network-vif-plugged-4613d21e-e71c-41e4-a386-adba5c84c717 for instance with vm_state building and task_state spawning.
Nov 30 07:11:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:11:55 user nova-compute[75293]: DEBUG nova.compute.manager [req-a3bf8576-8e10-47f3-97f4-4a9a0705bf32 req-d46cd24b-4325-4e62-bb06-e72a6de4ebdc service nova] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Received event network-vif-plugged-4613d21e-e71c-41e4-a386-adba5c84c717 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:11:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a3bf8576-8e10-47f3-97f4-4a9a0705bf32 req-d46cd24b-4325-4e62-bb06-e72a6de4ebdc service nova] Acquiring lock "e7b31625-f927-4e52-83d6-93cbc81d6c80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:11:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a3bf8576-8e10-47f3-97f4-4a9a0705bf32 req-d46cd24b-4325-4e62-bb06-e72a6de4ebdc service nova] Lock "e7b31625-f927-4e52-83d6-93cbc81d6c80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:11:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a3bf8576-8e10-47f3-97f4-4a9a0705bf32 req-d46cd24b-4325-4e62-bb06-e72a6de4ebdc service nova] Lock "e7b31625-f927-4e52-83d6-93cbc81d6c80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:55 user nova-compute[75293]: DEBUG nova.compute.manager [req-a3bf8576-8e10-47f3-97f4-4a9a0705bf32 req-d46cd24b-4325-4e62-bb06-e72a6de4ebdc service nova] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] No waiting events found dispatching network-vif-plugged-4613d21e-e71c-41e4-a386-adba5c84c717 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:11:55 user nova-compute[75293]: WARNING nova.compute.manager [req-a3bf8576-8e10-47f3-97f4-4a9a0705bf32 req-d46cd24b-4325-4e62-bb06-e72a6de4ebdc service nova] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Received unexpected event network-vif-plugged-4613d21e-e71c-41e4-a386-adba5c84c717 for instance with vm_state building and task_state spawning.
Nov 30 07:11:55 user nova-compute[75293]: DEBUG nova.compute.manager [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:11:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:11:55 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Instance spawned successfully.
Nov 30 07:11:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:11:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:11:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:11:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:11:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:11:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:11:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:11:56 user nova-compute[75293]: INFO nova.compute.manager [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Took 6.97 seconds to spawn the instance on the hypervisor.
Nov 30 07:11:56 user nova-compute[75293]: DEBUG nova.compute.manager [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:11:56 user nova-compute[75293]: INFO nova.compute.manager [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Took 7.80 seconds to build instance.
Nov 30 07:11:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bea8fad4-11ce-4c25-b2e7-d4ec6fbcef9b tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "e7b31625-f927-4e52-83d6-93cbc81d6c80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.940s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:11:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:00 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:12:00 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:12:00 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:12:00 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Didn't find any instances for network info cache update. {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 07:12:00 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:12:00 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:12:00 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:12:00 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:12:00 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:12:00 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:12:00 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:12:00 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:12:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:12:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:02 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:12:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk.rescue --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk.rescue --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:12:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:12:05 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:12:05 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:12:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=7677MB free_disk=25.291011810302734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:12:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b6dee8d-d419-47a3-b2be-4d15e17d6061 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:12:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b7deb0a-39af-4d93-b93d-5765a731f702 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:12:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 061832ab-930a-470b-8b4f-dfc8f19fea6b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:12:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:12:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 5c5d7382-107c-49af-bdc5-3600ab6425e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:12:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 009f70bc-7561-48fe-ba47-ebaf4d81d462 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:12:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 251604ac-b300-49ae-ae1a-4543665fead6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:12:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance e7b31625-f927-4e52-83d6-93cbc81d6c80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:12:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:12:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:12:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:05 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:12:05 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:12:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:12:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.547s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-d91da4ca-ece8-4f1e-98f6-7ff2c94a2fa4 req-2b312620-2bfe-4317-803f-3449e0552c4e service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received event network-changed-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-d91da4ca-ece8-4f1e-98f6-7ff2c94a2fa4 req-2b312620-2bfe-4317-803f-3449e0552c4e service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Refreshing instance network info cache due to event network-changed-fd8381e1-d2ff-4b1c-a6ed-704604abc20d. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:12:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d91da4ca-ece8-4f1e-98f6-7ff2c94a2fa4 req-2b312620-2bfe-4317-803f-3449e0552c4e service nova] Acquiring lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:12:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d91da4ca-ece8-4f1e-98f6-7ff2c94a2fa4 req-2b312620-2bfe-4317-803f-3449e0552c4e service nova] Acquired lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:12:17 user nova-compute[75293]: DEBUG nova.network.neutron [req-d91da4ca-ece8-4f1e-98f6-7ff2c94a2fa4 req-2b312620-2bfe-4317-803f-3449e0552c4e service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Refreshing network info cache for port fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:12:18 user nova-compute[75293]: DEBUG nova.network.neutron [req-d91da4ca-ece8-4f1e-98f6-7ff2c94a2fa4 req-2b312620-2bfe-4317-803f-3449e0552c4e service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Updated VIF entry in instance network info cache for port fd8381e1-d2ff-4b1c-a6ed-704604abc20d. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:12:18 user nova-compute[75293]: DEBUG nova.network.neutron [req-d91da4ca-ece8-4f1e-98f6-7ff2c94a2fa4 req-2b312620-2bfe-4317-803f-3449e0552c4e service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Updating instance_info_cache with network_info: [{"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:12:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d91da4ca-ece8-4f1e-98f6-7ff2c94a2fa4 req-2b312620-2bfe-4317-803f-3449e0552c4e service nova] Releasing lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:12:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:18 user nova-compute[75293]: INFO nova.compute.manager [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Detaching volume 70c2fd19-a79e-4b40-8116-072dafa1a09d
Nov 30 07:12:18 user nova-compute[75293]: INFO nova.virt.block_device [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Attempting to driver detach volume 70c2fd19-a79e-4b40-8116-072dafa1a09d from mountpoint /dev/vdb
Nov 30 07:12:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Attempting to detach device vdb from instance 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:12:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:12:18 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:12:18 user nova-compute[75293]:   <source dev="/dev/sdb"/>
Nov 30 07:12:18 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:12:18 user nova-compute[75293]:   <serial>70c2fd19-a79e-4b40-8116-072dafa1a09d</serial>
Nov 30 07:12:18 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 07:12:18 user nova-compute[75293]: </disk>
Nov 30 07:12:18 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:12:18 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Successfully detached device vdb from instance 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 from the persistent domain config.
Nov 30 07:12:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:12:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:12:18 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:12:18 user nova-compute[75293]:   <source dev="/dev/sdb"/>
Nov 30 07:12:18 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:12:18 user nova-compute[75293]:   <serial>70c2fd19-a79e-4b40-8116-072dafa1a09d</serial>
Nov 30 07:12:18 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 07:12:18 user nova-compute[75293]: </disk>
Nov 30 07:12:18 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:12:19 user nova-compute[75293]: DEBUG nova.compute.manager [req-63f65e15-3b56-41f7-8c43-d8a87a3616b6 req-4dfcbf75-86d5-4d9a-b031-96857afaff91 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received event network-changed-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:19 user nova-compute[75293]: DEBUG nova.compute.manager [req-63f65e15-3b56-41f7-8c43-d8a87a3616b6 req-4dfcbf75-86d5-4d9a-b031-96857afaff91 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Refreshing instance network info cache due to event network-changed-fd8381e1-d2ff-4b1c-a6ed-704604abc20d. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:12:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-63f65e15-3b56-41f7-8c43-d8a87a3616b6 req-4dfcbf75-86d5-4d9a-b031-96857afaff91 service nova] Acquiring lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:12:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-63f65e15-3b56-41f7-8c43-d8a87a3616b6 req-4dfcbf75-86d5-4d9a-b031-96857afaff91 service nova] Acquired lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:12:19 user nova-compute[75293]: DEBUG nova.network.neutron [req-63f65e15-3b56-41f7-8c43-d8a87a3616b6 req-4dfcbf75-86d5-4d9a-b031-96857afaff91 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Refreshing network info cache for port fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:12:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:12:19 user nova-compute[75293]: DEBUG nova.network.neutron [req-63f65e15-3b56-41f7-8c43-d8a87a3616b6 req-4dfcbf75-86d5-4d9a-b031-96857afaff91 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Updated VIF entry in instance network info cache for port fd8381e1-d2ff-4b1c-a6ed-704604abc20d. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:12:19 user nova-compute[75293]: DEBUG nova.network.neutron [req-63f65e15-3b56-41f7-8c43-d8a87a3616b6 req-4dfcbf75-86d5-4d9a-b031-96857afaff91 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Updating instance_info_cache with network_info: [{"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:12:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-63f65e15-3b56-41f7-8c43-d8a87a3616b6 req-4dfcbf75-86d5-4d9a-b031-96857afaff91 service nova] Releasing lock "refresh_cache-1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:12:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "5c5d7382-107c-49af-bdc5-3600ab6425e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "5c5d7382-107c-49af-bdc5-3600ab6425e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "5c5d7382-107c-49af-bdc5-3600ab6425e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "5c5d7382-107c-49af-bdc5-3600ab6425e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "5c5d7382-107c-49af-bdc5-3600ab6425e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:25 user nova-compute[75293]: INFO nova.compute.manager [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Terminating instance
Nov 30 07:12:25 user nova-compute[75293]: DEBUG nova.compute.manager [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG nova.compute.manager [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:12:26 user nova-compute[75293]: INFO nova.compute.claims [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Claim successful on node user
Nov 30 07:12:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-d21bdbd7-f19f-48f9-b230-7351aa6f28bb req-81e55c68-f265-47b8-9901-2c87053268ab service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Received event network-vif-unplugged-6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d21bdbd7-f19f-48f9-b230-7351aa6f28bb req-81e55c68-f265-47b8-9901-2c87053268ab service nova] Acquiring lock "5c5d7382-107c-49af-bdc5-3600ab6425e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d21bdbd7-f19f-48f9-b230-7351aa6f28bb req-81e55c68-f265-47b8-9901-2c87053268ab service nova] Lock "5c5d7382-107c-49af-bdc5-3600ab6425e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d21bdbd7-f19f-48f9-b230-7351aa6f28bb req-81e55c68-f265-47b8-9901-2c87053268ab service nova] Lock "5c5d7382-107c-49af-bdc5-3600ab6425e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-d21bdbd7-f19f-48f9-b230-7351aa6f28bb req-81e55c68-f265-47b8-9901-2c87053268ab service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] No waiting events found dispatching network-vif-unplugged-6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-d21bdbd7-f19f-48f9-b230-7351aa6f28bb req-81e55c68-f265-47b8-9901-2c87053268ab service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Received event network-vif-unplugged-6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:26 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Instance destroyed successfully.
Nov 30 07:12:26 user nova-compute[75293]: DEBUG nova.objects.instance [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lazy-loading 'resources' on Instance uuid 5c5d7382-107c-49af-bdc5-3600ab6425e8 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:10:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1414652166',display_name='tempest-VolumesAdminNegativeTest-server-1414652166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1414652166',id=13,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:10:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba486b18243b4462a2a4c35b6c478a0a',ramdisk_id='',reservation_id='r-a36pdxmx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1001198017',owner_user_name='tempest-VolumesAdminNegativeTest-1001198017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:10:28Z,user_data=None,user_id='a489452874654d99ba7f7b68eb62d30b',uuid=5c5d7382-107c-49af-bdc5-3600ab6425e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "address": "fa:16:3e:b4:a2:f0", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6106eeb2-5f", "ovs_interfaceid": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Converting VIF {"id": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "address": "fa:16:3e:b4:a2:f0", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6106eeb2-5f", "ovs_interfaceid": "6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:a2:f0,bridge_name='br-int',has_traffic_filtering=True,id=6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5,network=Network(43e6a947-eef6-4e52-afaf-c2defb3200b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6106eeb2-5f') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG os_vif [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:a2:f0,bridge_name='br-int',has_traffic_filtering=True,id=6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5,network=Network(43e6a947-eef6-4e52-afaf-c2defb3200b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6106eeb2-5f') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6106eeb2-5f, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e679b41b-33fb-45c0-a3d1-c057e1517a18) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:12:26 user nova-compute[75293]: INFO os_vif [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:a2:f0,bridge_name='br-int',has_traffic_filtering=True,id=6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5,network=Network(43e6a947-eef6-4e52-afaf-c2defb3200b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6106eeb2-5f')
Nov 30 07:12:26 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Deleting instance files /opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8_del
Nov 30 07:12:26 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Deletion of /opt/stack/data/nova/instances/5c5d7382-107c-49af-bdc5-3600ab6425e8_del complete
Nov 30 07:12:26 user nova-compute[75293]: INFO nova.compute.manager [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 30 07:12:26 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:12:26 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:12:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:12:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:12:27 user nova-compute[75293]: DEBUG nova.network.neutron [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:12:27 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:12:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:12:27 user nova-compute[75293]: DEBUG nova.policy [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83119c1bbe4142a086680a113403018c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09e4044dadb4f2aa0d29f35f23008d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:12:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:12:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:12:27 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Creating image(s)
Nov 30 07:12:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "/opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "/opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:27 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG nova.compute.manager [req-f18b91ea-3f08-41f1-b04d-9f3b30af77de req-da3e0503-0f9e-4c53-b50b-8c631f41c711 service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Received event network-vif-deleted-6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:28 user nova-compute[75293]: INFO nova.compute.manager [req-f18b91ea-3f08-41f1-b04d-9f3b30af77de req-da3e0503-0f9e-4c53-b50b-8c631f41c711 service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Neutron deleted interface 6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5; detaching it from the instance and deleting it from the info cache
Nov 30 07:12:28 user nova-compute[75293]: DEBUG nova.network.neutron [req-f18b91ea-3f08-41f1-b04d-9f3b30af77de req-da3e0503-0f9e-4c53-b50b-8c631f41c711 service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:12:28 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Took 0.60 seconds to deallocate network for instance.
Nov 30 07:12:28 user nova-compute[75293]: DEBUG nova.compute.manager [req-f18b91ea-3f08-41f1-b04d-9f3b30af77de req-da3e0503-0f9e-4c53-b50b-8c631f41c711 service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Detach interface failed, port_id=6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5, reason: Instance 5c5d7382-107c-49af-bdc5-3600ab6425e8 could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.204s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.188s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk 1073741824" returned: 0 in 0.202s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.395s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.282s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Cannot resize image /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Ensure instance console log exists: /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG nova.compute.manager [req-cb6c99bb-32a6-421d-b0cd-f9c03279cfb9 req-47db2839-8e8a-4172-b120-927847e1bed1 service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Received event network-vif-plugged-6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cb6c99bb-32a6-421d-b0cd-f9c03279cfb9 req-47db2839-8e8a-4172-b120-927847e1bed1 service nova] Acquiring lock "5c5d7382-107c-49af-bdc5-3600ab6425e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cb6c99bb-32a6-421d-b0cd-f9c03279cfb9 req-47db2839-8e8a-4172-b120-927847e1bed1 service nova] Lock "5c5d7382-107c-49af-bdc5-3600ab6425e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cb6c99bb-32a6-421d-b0cd-f9c03279cfb9 req-47db2839-8e8a-4172-b120-927847e1bed1 service nova] Lock "5c5d7382-107c-49af-bdc5-3600ab6425e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG nova.compute.manager [req-cb6c99bb-32a6-421d-b0cd-f9c03279cfb9 req-47db2839-8e8a-4172-b120-927847e1bed1 service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] No waiting events found dispatching network-vif-plugged-6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:12:28 user nova-compute[75293]: WARNING nova.compute.manager [req-cb6c99bb-32a6-421d-b0cd-f9c03279cfb9 req-47db2839-8e8a-4172-b120-927847e1bed1 service nova] [instance: 5c5d7382-107c-49af-bdc5-3600ab6425e8] Received unexpected event network-vif-plugged-6106eeb2-5fa3-44c9-a856-7f3c5e2ebdc5 for instance with vm_state deleted and task_state None.
Nov 30 07:12:28 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.844s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:28 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Deleted allocations for instance 5c5d7382-107c-49af-bdc5-3600ab6425e8
Nov 30 07:12:28 user nova-compute[75293]: DEBUG nova.network.neutron [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Successfully created port: 66299713-0237-47db-9fef-e5816beed9d9 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:12:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-47e5bf36-db78-48e6-9763-f9e2020ddcc2 tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "5c5d7382-107c-49af-bdc5-3600ab6425e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.960s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:29 user nova-compute[75293]: DEBUG nova.network.neutron [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Successfully updated port: 66299713-0237-47db-9fef-e5816beed9d9 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:12:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "refresh_cache-c8d1df78-2aa2-4710-a570-5f72c60cfc26" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:12:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquired lock "refresh_cache-c8d1df78-2aa2-4710-a570-5f72c60cfc26" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:12:29 user nova-compute[75293]: DEBUG nova.network.neutron [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:12:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-1914b2f9-dfad-4e06-8d72-700d0d348ab2 req-a59711cc-2535-4ffa-9033-e8862bcbff86 service nova] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Received event network-changed-66299713-0237-47db-9fef-e5816beed9d9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-1914b2f9-dfad-4e06-8d72-700d0d348ab2 req-a59711cc-2535-4ffa-9033-e8862bcbff86 service nova] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Refreshing instance network info cache due to event network-changed-66299713-0237-47db-9fef-e5816beed9d9. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:12:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1914b2f9-dfad-4e06-8d72-700d0d348ab2 req-a59711cc-2535-4ffa-9033-e8862bcbff86 service nova] Acquiring lock "refresh_cache-c8d1df78-2aa2-4710-a570-5f72c60cfc26" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:12:29 user nova-compute[75293]: DEBUG nova.network.neutron [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:12:29 user nova-compute[75293]: DEBUG nova.network.neutron [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Updating instance_info_cache with network_info: [{"id": "66299713-0237-47db-9fef-e5816beed9d9", "address": "fa:16:3e:db:c2:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66299713-02", "ovs_interfaceid": "66299713-0237-47db-9fef-e5816beed9d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:12:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Releasing lock "refresh_cache-c8d1df78-2aa2-4710-a570-5f72c60cfc26" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:12:29 user nova-compute[75293]: DEBUG nova.compute.manager [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Instance network_info: |[{"id": "66299713-0237-47db-9fef-e5816beed9d9", "address": "fa:16:3e:db:c2:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66299713-02", "ovs_interfaceid": "66299713-0237-47db-9fef-e5816beed9d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:12:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1914b2f9-dfad-4e06-8d72-700d0d348ab2 req-a59711cc-2535-4ffa-9033-e8862bcbff86 service nova] Acquired lock "refresh_cache-c8d1df78-2aa2-4710-a570-5f72c60cfc26" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:12:29 user nova-compute[75293]: DEBUG nova.network.neutron [req-1914b2f9-dfad-4e06-8d72-700d0d348ab2 req-a59711cc-2535-4ffa-9033-e8862bcbff86 service nova] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Refreshing network info cache for port 66299713-0237-47db-9fef-e5816beed9d9 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:12:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Start _get_guest_xml network_info=[{"id": "66299713-0237-47db-9fef-e5816beed9d9", "address": "fa:16:3e:db:c2:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66299713-02", "ovs_interfaceid": "66299713-0237-47db-9fef-e5816beed9d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:12:29 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:12:29 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:12:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:12:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:12:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:12:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:12:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-399307917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-399307917',id=16,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09e4044dadb4f2aa0d29f35f23008d2',ramdisk_id='',reservation_id='r-i5oahpg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:12:27Z,user_data=None,user_id='83119c1bbe4142a086680a113403018c',uuid=c8d1df78-2aa2-4710-a570-5f72c60cfc26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66299713-0237-47db-9fef-e5816beed9d9", "address": "fa:16:3e:db:c2:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66299713-02", "ovs_interfaceid": "66299713-0237-47db-9fef-e5816beed9d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converting VIF {"id": "66299713-0237-47db-9fef-e5816beed9d9", "address": "fa:16:3e:db:c2:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66299713-02", "ovs_interfaceid": "66299713-0237-47db-9fef-e5816beed9d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:c2:51,bridge_name='br-int',has_traffic_filtering=True,id=66299713-0237-47db-9fef-e5816beed9d9,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66299713-02') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.objects.instance [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'pci_devices' on Instance uuid c8d1df78-2aa2-4710-a570-5f72c60cfc26 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:12:30 user nova-compute[75293]:   <uuid>c8d1df78-2aa2-4710-a570-5f72c60cfc26</uuid>
Nov 30 07:12:30 user nova-compute[75293]:   <name>instance-00000010</name>
Nov 30 07:12:30 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:12:30 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:12:30 user nova-compute[75293]:   <metadata>
Nov 30 07:12:30 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:12:30 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:12:30 user nova-compute[75293]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-399307917</nova:name>
Nov 30 07:12:30 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:12:29</nova:creationTime>
Nov 30 07:12:30 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:12:30 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:12:30 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:12:30 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:12:30 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:12:30 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:12:30 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:12:30 user nova-compute[75293]:       <nova:owner>
Nov 30 07:12:30 user nova-compute[75293]:         <nova:user uuid="83119c1bbe4142a086680a113403018c">tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member</nova:user>
Nov 30 07:12:30 user nova-compute[75293]:         <nova:project uuid="f09e4044dadb4f2aa0d29f35f23008d2">tempest-ServerBootFromVolumeStableRescueTest-2053873633</nova:project>
Nov 30 07:12:30 user nova-compute[75293]:       </nova:owner>
Nov 30 07:12:30 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:12:30 user nova-compute[75293]:       <nova:ports>
Nov 30 07:12:30 user nova-compute[75293]:         <nova:port uuid="66299713-0237-47db-9fef-e5816beed9d9">
Nov 30 07:12:30 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 07:12:30 user nova-compute[75293]:         </nova:port>
Nov 30 07:12:30 user nova-compute[75293]:       </nova:ports>
Nov 30 07:12:30 user nova-compute[75293]:     </nova:instance>
Nov 30 07:12:30 user nova-compute[75293]:   </metadata>
Nov 30 07:12:30 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:12:30 user nova-compute[75293]:     <system>
Nov 30 07:12:30 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:12:30 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:12:30 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:12:30 user nova-compute[75293]:       <entry name="serial">c8d1df78-2aa2-4710-a570-5f72c60cfc26</entry>
Nov 30 07:12:30 user nova-compute[75293]:       <entry name="uuid">c8d1df78-2aa2-4710-a570-5f72c60cfc26</entry>
Nov 30 07:12:30 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:12:30 user nova-compute[75293]:     </system>
Nov 30 07:12:30 user nova-compute[75293]:   </sysinfo>
Nov 30 07:12:30 user nova-compute[75293]:   <os>
Nov 30 07:12:30 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:12:30 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:12:30 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:12:30 user nova-compute[75293]:   </os>
Nov 30 07:12:30 user nova-compute[75293]:   <features>
Nov 30 07:12:30 user nova-compute[75293]:     <acpi/>
Nov 30 07:12:30 user nova-compute[75293]:     <apic/>
Nov 30 07:12:30 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:12:30 user nova-compute[75293]:   </features>
Nov 30 07:12:30 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:12:30 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:12:30 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:12:30 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:12:30 user nova-compute[75293]:   </clock>
Nov 30 07:12:30 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:12:30 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:12:30 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:12:30 user nova-compute[75293]:   </cpu>
Nov 30 07:12:30 user nova-compute[75293]:   <devices>
Nov 30 07:12:30 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:12:30 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:12:30 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk"/>
Nov 30 07:12:30 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:12:30 user nova-compute[75293]:     </disk>
Nov 30 07:12:30 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:12:30 user nova-compute[75293]:       <mac address="fa:16:3e:db:c2:51"/>
Nov 30 07:12:30 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:12:30 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:12:30 user nova-compute[75293]:       <target dev="tap66299713-02"/>
Nov 30 07:12:30 user nova-compute[75293]:     </interface>
Nov 30 07:12:30 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:12:30 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/console.log" append="off"/>
Nov 30 07:12:30 user nova-compute[75293]:     </serial>
Nov 30 07:12:30 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:12:30 user nova-compute[75293]:     <video>
Nov 30 07:12:30 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:12:30 user nova-compute[75293]:     </video>
Nov 30 07:12:30 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:12:30 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:12:30 user nova-compute[75293]:     </rng>
Nov 30 07:12:30 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:12:30 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:12:30 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:12:30 user nova-compute[75293]:     </memballoon>
Nov 30 07:12:30 user nova-compute[75293]:   </devices>
Nov 30 07:12:30 user nova-compute[75293]: </domain>
Nov 30 07:12:30 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-399307917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-399307917',id=16,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09e4044dadb4f2aa0d29f35f23008d2',ramdisk_id='',reservation_id='r-i5oahpg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:12:27Z,user_data=None,user_id='83119c1bbe4142a086680a113403018c',uuid=c8d1df78-2aa2-4710-a570-5f72c60cfc26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66299713-0237-47db-9fef-e5816beed9d9", "address": "fa:16:3e:db:c2:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66299713-02", "ovs_interfaceid": "66299713-0237-47db-9fef-e5816beed9d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converting VIF {"id": "66299713-0237-47db-9fef-e5816beed9d9", "address": "fa:16:3e:db:c2:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66299713-02", "ovs_interfaceid": "66299713-0237-47db-9fef-e5816beed9d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:c2:51,bridge_name='br-int',has_traffic_filtering=True,id=66299713-0237-47db-9fef-e5816beed9d9,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66299713-02') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG os_vif [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:c2:51,bridge_name='br-int',has_traffic_filtering=True,id=66299713-0237-47db-9fef-e5816beed9d9,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66299713-02') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '566e06f9-5eb0-5a6f-b40d-1d5716e5ac86', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66299713-02, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66299713-02, col_values=(('qos', UUID('4dfb0d1e-8cac-4251-acb2-d52759399d8a')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66299713-02, col_values=(('external_ids', {'iface-id': '66299713-0237-47db-9fef-e5816beed9d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:c2:51', 'vm-uuid': 'c8d1df78-2aa2-4710-a570-5f72c60cfc26'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:30 user nova-compute[75293]: INFO os_vif [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:c2:51,bridge_name='br-int',has_traffic_filtering=True,id=66299713-0237-47db-9fef-e5816beed9d9,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66299713-02')
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] No VIF found with MAC fa:16:3e:db:c2:51, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquiring lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.compute.manager [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.network.neutron [req-1914b2f9-dfad-4e06-8d72-700d0d348ab2 req-a59711cc-2535-4ffa-9033-e8862bcbff86 service nova] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Updated VIF entry in instance network info cache for port 66299713-0237-47db-9fef-e5816beed9d9. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.network.neutron [req-1914b2f9-dfad-4e06-8d72-700d0d348ab2 req-a59711cc-2535-4ffa-9033-e8862bcbff86 service nova] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Updating instance_info_cache with network_info: [{"id": "66299713-0237-47db-9fef-e5816beed9d9", "address": "fa:16:3e:db:c2:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66299713-02", "ovs_interfaceid": "66299713-0237-47db-9fef-e5816beed9d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1914b2f9-dfad-4e06-8d72-700d0d348ab2 req-a59711cc-2535-4ffa-9033-e8862bcbff86 service nova] Releasing lock "refresh_cache-c8d1df78-2aa2-4710-a570-5f72c60cfc26" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:12:30 user nova-compute[75293]: INFO nova.compute.claims [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Claim successful on node user
Nov 30 07:12:31 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG nova.compute.manager [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG nova.compute.manager [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG nova.network.neutron [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:12:31 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:12:31 user nova-compute[75293]: DEBUG nova.compute.manager [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG nova.policy [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09ce91e4a92b4ee9acd2c4c9929574ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379a38913c014e62b5b0256318c92dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG nova.compute.manager [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:12:31 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Creating image(s)
Nov 30 07:12:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "/opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "/opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG nova.compute.manager [req-208eead0-2eed-46a2-89f0-0087b162a9b5 req-5bb78570-d489-4164-9713-7a40d6dbabb0 service nova] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Received event network-vif-plugged-66299713-0237-47db-9fef-e5816beed9d9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-208eead0-2eed-46a2-89f0-0087b162a9b5 req-5bb78570-d489-4164-9713-7a40d6dbabb0 service nova] Acquiring lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-208eead0-2eed-46a2-89f0-0087b162a9b5 req-5bb78570-d489-4164-9713-7a40d6dbabb0 service nova] Lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-208eead0-2eed-46a2-89f0-0087b162a9b5 req-5bb78570-d489-4164-9713-7a40d6dbabb0 service nova] Lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG nova.compute.manager [req-208eead0-2eed-46a2-89f0-0087b162a9b5 req-5bb78570-d489-4164-9713-7a40d6dbabb0 service nova] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] No waiting events found dispatching network-vif-plugged-66299713-0237-47db-9fef-e5816beed9d9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:12:31 user nova-compute[75293]: WARNING nova.compute.manager [req-208eead0-2eed-46a2-89f0-0087b162a9b5 req-5bb78570-d489-4164-9713-7a40d6dbabb0 service nova] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Received unexpected event network-vif-plugged-66299713-0237-47db-9fef-e5816beed9d9 for instance with vm_state building and task_state spawning.
Nov 30 07:12:31 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.189s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:31 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.246s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/disk 1073741824" returned: 0 in 0.060s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG nova.network.neutron [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Successfully created port: 1cfef24d-7ee5-48b3-ab67-91b977aa25c3 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.190s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Cannot resize image /opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Ensure instance console log exists: /opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG nova.network.neutron [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Successfully updated port: 1cfef24d-7ee5-48b3-ab67-91b977aa25c3 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquiring lock "refresh_cache-0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquired lock "refresh_cache-0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG nova.network.neutron [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-ab300b41-8b28-41ce-8675-6508bf684437 req-0345ef07-bec2-4855-9ed8-abfbd2e5e45e service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Received event network-changed-1cfef24d-7ee5-48b3-ab67-91b977aa25c3 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-ab300b41-8b28-41ce-8675-6508bf684437 req-0345ef07-bec2-4855-9ed8-abfbd2e5e45e service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Refreshing instance network info cache due to event network-changed-1cfef24d-7ee5-48b3-ab67-91b977aa25c3. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ab300b41-8b28-41ce-8675-6508bf684437 req-0345ef07-bec2-4855-9ed8-abfbd2e5e45e service nova] Acquiring lock "refresh_cache-0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:12:32 user nova-compute[75293]: DEBUG nova.network.neutron [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.network.neutron [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Updating instance_info_cache with network_info: [{"id": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "address": "fa:16:3e:42:67:c2", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfef24d-7e", "ovs_interfaceid": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Releasing lock "refresh_cache-0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.compute.manager [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Instance network_info: |[{"id": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "address": "fa:16:3e:42:67:c2", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfef24d-7e", "ovs_interfaceid": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ab300b41-8b28-41ce-8675-6508bf684437 req-0345ef07-bec2-4855-9ed8-abfbd2e5e45e service nova] Acquired lock "refresh_cache-0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.network.neutron [req-ab300b41-8b28-41ce-8675-6508bf684437 req-0345ef07-bec2-4855-9ed8-abfbd2e5e45e service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Refreshing network info cache for port 1cfef24d-7ee5-48b3-ab67-91b977aa25c3 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Start _get_guest_xml network_info=[{"id": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "address": "fa:16:3e:42:67:c2", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfef24d-7e", "ovs_interfaceid": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:12:33 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:12:33 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:12:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-44308926',display_name='tempest-VolumesActionsTest-instance-44308926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-44308926',id=17,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='379a38913c014e62b5b0256318c92dd8',ramdisk_id='',reservation_id='r-3o3600tu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2065132499',owner_user_name='tempest-VolumesActionsTest-2065132499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:12:31Z,user_data=None,user_id='09ce91e4a92b4ee9acd2c4c9929574ff',uuid=0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "address": "fa:16:3e:42:67:c2", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfef24d-7e", "ovs_interfaceid": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Converting VIF {"id": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "address": "fa:16:3e:42:67:c2", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfef24d-7e", "ovs_interfaceid": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:67:c2,bridge_name='br-int',has_traffic_filtering=True,id=1cfef24d-7ee5-48b3-ab67-91b977aa25c3,network=Network(9d47d272-ffeb-4f6c-9246-2acefdf615a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cfef24d-7e') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.objects.instance [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:12:33 user nova-compute[75293]:   <uuid>0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64</uuid>
Nov 30 07:12:33 user nova-compute[75293]:   <name>instance-00000011</name>
Nov 30 07:12:33 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:12:33 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:12:33 user nova-compute[75293]:   <metadata>
Nov 30 07:12:33 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:12:33 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:12:33 user nova-compute[75293]:       <nova:name>tempest-VolumesActionsTest-instance-44308926</nova:name>
Nov 30 07:12:33 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:12:33</nova:creationTime>
Nov 30 07:12:33 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:12:33 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:12:33 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:12:33 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:12:33 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:12:33 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:12:33 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:12:33 user nova-compute[75293]:       <nova:owner>
Nov 30 07:12:33 user nova-compute[75293]:         <nova:user uuid="09ce91e4a92b4ee9acd2c4c9929574ff">tempest-VolumesActionsTest-2065132499-project-member</nova:user>
Nov 30 07:12:33 user nova-compute[75293]:         <nova:project uuid="379a38913c014e62b5b0256318c92dd8">tempest-VolumesActionsTest-2065132499</nova:project>
Nov 30 07:12:33 user nova-compute[75293]:       </nova:owner>
Nov 30 07:12:33 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:12:33 user nova-compute[75293]:       <nova:ports>
Nov 30 07:12:33 user nova-compute[75293]:         <nova:port uuid="1cfef24d-7ee5-48b3-ab67-91b977aa25c3">
Nov 30 07:12:33 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 30 07:12:33 user nova-compute[75293]:         </nova:port>
Nov 30 07:12:33 user nova-compute[75293]:       </nova:ports>
Nov 30 07:12:33 user nova-compute[75293]:     </nova:instance>
Nov 30 07:12:33 user nova-compute[75293]:   </metadata>
Nov 30 07:12:33 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:12:33 user nova-compute[75293]:     <system>
Nov 30 07:12:33 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:12:33 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:12:33 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:12:33 user nova-compute[75293]:       <entry name="serial">0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64</entry>
Nov 30 07:12:33 user nova-compute[75293]:       <entry name="uuid">0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64</entry>
Nov 30 07:12:33 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:12:33 user nova-compute[75293]:     </system>
Nov 30 07:12:33 user nova-compute[75293]:   </sysinfo>
Nov 30 07:12:33 user nova-compute[75293]:   <os>
Nov 30 07:12:33 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:12:33 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:12:33 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:12:33 user nova-compute[75293]:   </os>
Nov 30 07:12:33 user nova-compute[75293]:   <features>
Nov 30 07:12:33 user nova-compute[75293]:     <acpi/>
Nov 30 07:12:33 user nova-compute[75293]:     <apic/>
Nov 30 07:12:33 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:12:33 user nova-compute[75293]:   </features>
Nov 30 07:12:33 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:12:33 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:12:33 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:12:33 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:12:33 user nova-compute[75293]:   </clock>
Nov 30 07:12:33 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:12:33 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:12:33 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:12:33 user nova-compute[75293]:   </cpu>
Nov 30 07:12:33 user nova-compute[75293]:   <devices>
Nov 30 07:12:33 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:12:33 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:12:33 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/disk"/>
Nov 30 07:12:33 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:12:33 user nova-compute[75293]:     </disk>
Nov 30 07:12:33 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:12:33 user nova-compute[75293]:       <mac address="fa:16:3e:42:67:c2"/>
Nov 30 07:12:33 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:12:33 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:12:33 user nova-compute[75293]:       <target dev="tap1cfef24d-7e"/>
Nov 30 07:12:33 user nova-compute[75293]:     </interface>
Nov 30 07:12:33 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:12:33 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/console.log" append="off"/>
Nov 30 07:12:33 user nova-compute[75293]:     </serial>
Nov 30 07:12:33 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:12:33 user nova-compute[75293]:     <video>
Nov 30 07:12:33 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:12:33 user nova-compute[75293]:     </video>
Nov 30 07:12:33 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:12:33 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:12:33 user nova-compute[75293]:     </rng>
Nov 30 07:12:33 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:12:33 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:12:33 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:12:33 user nova-compute[75293]:     </memballoon>
Nov 30 07:12:33 user nova-compute[75293]:   </devices>
Nov 30 07:12:33 user nova-compute[75293]: </domain>
Nov 30 07:12:33 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:12:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-44308926',display_name='tempest-VolumesActionsTest-instance-44308926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-44308926',id=17,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='379a38913c014e62b5b0256318c92dd8',ramdisk_id='',reservation_id='r-3o3600tu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2065132499',owner_user_name='tempest-VolumesActionsTest-2065132499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:12:31Z,user_data=None,user_id='09ce91e4a92b4ee9acd2c4c9929574ff',uuid=0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "address": "fa:16:3e:42:67:c2", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfef24d-7e", "ovs_interfaceid": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Converting VIF {"id": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "address": "fa:16:3e:42:67:c2", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfef24d-7e", "ovs_interfaceid": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:67:c2,bridge_name='br-int',has_traffic_filtering=True,id=1cfef24d-7ee5-48b3-ab67-91b977aa25c3,network=Network(9d47d272-ffeb-4f6c-9246-2acefdf615a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cfef24d-7e') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG os_vif [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:67:c2,bridge_name='br-int',has_traffic_filtering=True,id=1cfef24d-7ee5-48b3-ab67-91b977aa25c3,network=Network(9d47d272-ffeb-4f6c-9246-2acefdf615a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cfef24d-7e') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9be9a13c-d0dc-5fc8-a6eb-0782965de787', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1cfef24d-7e, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1cfef24d-7e, col_values=(('qos', UUID('ed06dda6-bced-458f-8a8c-4675417d7728')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1cfef24d-7e, col_values=(('external_ids', {'iface-id': '1cfef24d-7ee5-48b3-ab67-91b977aa25c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:67:c2', 'vm-uuid': '0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:33 user nova-compute[75293]: INFO os_vif [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:67:c2,bridge_name='br-int',has_traffic_filtering=True,id=1cfef24d-7ee5-48b3-ab67-91b977aa25c3,network=Network(9d47d272-ffeb-4f6c-9246-2acefdf615a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cfef24d-7e')
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] No VIF found with MAC fa:16:3e:42:67:c2, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.network.neutron [req-ab300b41-8b28-41ce-8675-6508bf684437 req-0345ef07-bec2-4855-9ed8-abfbd2e5e45e service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Updated VIF entry in instance network info cache for port 1cfef24d-7ee5-48b3-ab67-91b977aa25c3. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.network.neutron [req-ab300b41-8b28-41ce-8675-6508bf684437 req-0345ef07-bec2-4855-9ed8-abfbd2e5e45e service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Updating instance_info_cache with network_info: [{"id": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "address": "fa:16:3e:42:67:c2", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfef24d-7e", "ovs_interfaceid": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ab300b41-8b28-41ce-8675-6508bf684437 req-0345ef07-bec2-4855-9ed8-abfbd2e5e45e service nova] Releasing lock "refresh_cache-0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.compute.manager [req-a85e9f04-7155-4a70-b83c-22995840d194 req-ee4ae40e-2c20-4712-ae27-2d27973cd1b3 service nova] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Received event network-vif-plugged-66299713-0237-47db-9fef-e5816beed9d9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a85e9f04-7155-4a70-b83c-22995840d194 req-ee4ae40e-2c20-4712-ae27-2d27973cd1b3 service nova] Acquiring lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a85e9f04-7155-4a70-b83c-22995840d194 req-ee4ae40e-2c20-4712-ae27-2d27973cd1b3 service nova] Lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a85e9f04-7155-4a70-b83c-22995840d194 req-ee4ae40e-2c20-4712-ae27-2d27973cd1b3 service nova] Lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.compute.manager [req-a85e9f04-7155-4a70-b83c-22995840d194 req-ee4ae40e-2c20-4712-ae27-2d27973cd1b3 service nova] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] No waiting events found dispatching network-vif-plugged-66299713-0237-47db-9fef-e5816beed9d9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:12:33 user nova-compute[75293]: WARNING nova.compute.manager [req-a85e9f04-7155-4a70-b83c-22995840d194 req-ee4ae40e-2c20-4712-ae27-2d27973cd1b3 service nova] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Received unexpected event network-vif-plugged-66299713-0237-47db-9fef-e5816beed9d9 for instance with vm_state building and task_state spawning.
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.compute.manager [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:12:33 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Instance spawned successfully.
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:12:33 user nova-compute[75293]: INFO nova.compute.manager [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Took 6.59 seconds to spawn the instance on the hypervisor.
Nov 30 07:12:33 user nova-compute[75293]: DEBUG nova.compute.manager [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:12:34 user nova-compute[75293]: INFO nova.compute.manager [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Took 7.56 seconds to build instance.
Nov 30 07:12:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-354f6645-a4d3-425c-9dd4-3f16cd04f7cc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.745s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:35 user nova-compute[75293]: DEBUG nova.compute.manager [req-62ad2c13-9c4d-4089-81bf-9a477004d68e req-27411bc6-6fef-4a41-bd47-a02b3c3fd548 service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Received event network-vif-plugged-1cfef24d-7ee5-48b3-ab67-91b977aa25c3 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-62ad2c13-9c4d-4089-81bf-9a477004d68e req-27411bc6-6fef-4a41-bd47-a02b3c3fd548 service nova] Acquiring lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-62ad2c13-9c4d-4089-81bf-9a477004d68e req-27411bc6-6fef-4a41-bd47-a02b3c3fd548 service nova] Lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-62ad2c13-9c4d-4089-81bf-9a477004d68e req-27411bc6-6fef-4a41-bd47-a02b3c3fd548 service nova] Lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:35 user nova-compute[75293]: DEBUG nova.compute.manager [req-62ad2c13-9c4d-4089-81bf-9a477004d68e req-27411bc6-6fef-4a41-bd47-a02b3c3fd548 service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] No waiting events found dispatching network-vif-plugged-1cfef24d-7ee5-48b3-ab67-91b977aa25c3 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:12:35 user nova-compute[75293]: WARNING nova.compute.manager [req-62ad2c13-9c4d-4089-81bf-9a477004d68e req-27411bc6-6fef-4a41-bd47-a02b3c3fd548 service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Received unexpected event network-vif-plugged-1cfef24d-7ee5-48b3-ab67-91b977aa25c3 for instance with vm_state building and task_state spawning.
Nov 30 07:12:35 user nova-compute[75293]: DEBUG nova.compute.manager [req-62ad2c13-9c4d-4089-81bf-9a477004d68e req-27411bc6-6fef-4a41-bd47-a02b3c3fd548 service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Received event network-vif-plugged-1cfef24d-7ee5-48b3-ab67-91b977aa25c3 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-62ad2c13-9c4d-4089-81bf-9a477004d68e req-27411bc6-6fef-4a41-bd47-a02b3c3fd548 service nova] Acquiring lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-62ad2c13-9c4d-4089-81bf-9a477004d68e req-27411bc6-6fef-4a41-bd47-a02b3c3fd548 service nova] Lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-62ad2c13-9c4d-4089-81bf-9a477004d68e req-27411bc6-6fef-4a41-bd47-a02b3c3fd548 service nova] Lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:35 user nova-compute[75293]: DEBUG nova.compute.manager [req-62ad2c13-9c4d-4089-81bf-9a477004d68e req-27411bc6-6fef-4a41-bd47-a02b3c3fd548 service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] No waiting events found dispatching network-vif-plugged-1cfef24d-7ee5-48b3-ab67-91b977aa25c3 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:12:35 user nova-compute[75293]: WARNING nova.compute.manager [req-62ad2c13-9c4d-4089-81bf-9a477004d68e req-27411bc6-6fef-4a41-bd47-a02b3c3fd548 service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Received unexpected event network-vif-plugged-1cfef24d-7ee5-48b3-ab67-91b977aa25c3 for instance with vm_state building and task_state spawning.
Nov 30 07:12:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "251604ac-b300-49ae-ae1a-4543665fead6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "251604ac-b300-49ae-ae1a-4543665fead6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:36 user nova-compute[75293]: INFO nova.compute.manager [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Detaching volume 1fd4498f-6a27-4f34-90e3-e80f4a1d16db
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.compute.manager [req-a467da1a-886d-4e68-b89e-ad8e9d0a1748 req-8c3ad752-273d-4904-a102-0f6b7e1eb011 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Received event network-changed-3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.compute.manager [req-a467da1a-886d-4e68-b89e-ad8e9d0a1748 req-8c3ad752-273d-4904-a102-0f6b7e1eb011 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Refreshing instance network info cache due to event network-changed-3d550d68-3322-4126-8dce-9201214e61f8. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a467da1a-886d-4e68-b89e-ad8e9d0a1748 req-8c3ad752-273d-4904-a102-0f6b7e1eb011 service nova] Acquiring lock "refresh_cache-009f70bc-7561-48fe-ba47-ebaf4d81d462" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a467da1a-886d-4e68-b89e-ad8e9d0a1748 req-8c3ad752-273d-4904-a102-0f6b7e1eb011 service nova] Acquired lock "refresh_cache-009f70bc-7561-48fe-ba47-ebaf4d81d462" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.network.neutron [req-a467da1a-886d-4e68-b89e-ad8e9d0a1748 req-8c3ad752-273d-4904-a102-0f6b7e1eb011 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Refreshing network info cache for port 3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:12:37 user nova-compute[75293]: INFO nova.virt.block_device [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Attempting to driver detach volume 1fd4498f-6a27-4f34-90e3-e80f4a1d16db from mountpoint /dev/vdc
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Attempting to detach device vdc from instance 251604ac-b300-49ae-ae1a-4543665fead6 from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:12:37 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:12:37 user nova-compute[75293]:   <source dev="/dev/sdd"/>
Nov 30 07:12:37 user nova-compute[75293]:   <target dev="vdc" bus="virtio"/>
Nov 30 07:12:37 user nova-compute[75293]:   <serial>1fd4498f-6a27-4f34-90e3-e80f4a1d16db</serial>
Nov 30 07:12:37 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 07:12:37 user nova-compute[75293]: </disk>
Nov 30 07:12:37 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:12:37 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Successfully detached device vdc from instance 251604ac-b300-49ae-ae1a-4543665fead6 from the persistent domain config.
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 251604ac-b300-49ae-ae1a-4543665fead6 from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:12:37 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:12:37 user nova-compute[75293]:   <source dev="/dev/sdd"/>
Nov 30 07:12:37 user nova-compute[75293]:   <target dev="vdc" bus="virtio"/>
Nov 30 07:12:37 user nova-compute[75293]:   <serial>1fd4498f-6a27-4f34-90e3-e80f4a1d16db</serial>
Nov 30 07:12:37 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 07:12:37 user nova-compute[75293]: </disk>
Nov 30 07:12:37 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.compute.manager [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:12:37 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Instance spawned successfully.
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:12:37 user nova-compute[75293]: INFO nova.compute.manager [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.compute.manager [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:12:37 user nova-compute[75293]: INFO nova.compute.manager [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Took 6.68 seconds to build instance.
Nov 30 07:12:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e629d647-f30f-4e43-8f97-b75842eaf6ea tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.801s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 251604ac-b300-49ae-ae1a-4543665fead6 {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.network.neutron [req-a467da1a-886d-4e68-b89e-ad8e9d0a1748 req-8c3ad752-273d-4904-a102-0f6b7e1eb011 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Updated VIF entry in instance network info cache for port 3d550d68-3322-4126-8dce-9201214e61f8. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.network.neutron [req-a467da1a-886d-4e68-b89e-ad8e9d0a1748 req-8c3ad752-273d-4904-a102-0f6b7e1eb011 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Updating instance_info_cache with network_info: [{"id": "3d550d68-3322-4126-8dce-9201214e61f8", "address": "fa:16:3e:79:15:d4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d550d68-33", "ovs_interfaceid": "3d550d68-3322-4126-8dce-9201214e61f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a467da1a-886d-4e68-b89e-ad8e9d0a1748 req-8c3ad752-273d-4904-a102-0f6b7e1eb011 service nova] Releasing lock "refresh_cache-009f70bc-7561-48fe-ba47-ebaf4d81d462" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "009f70bc-7561-48fe-ba47-ebaf4d81d462" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lazy-loading 'flavor' on Instance uuid 009f70bc-7561-48fe-ba47-ebaf4d81d462 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "009f70bc-7561-48fe-ba47-ebaf4d81d462" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:37 user nova-compute[75293]: INFO nova.compute.manager [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Attaching volume c9bf2351-4111-4c11-b609-97a218ac8ba5 to /dev/vdb
Nov 30 07:12:37 user nova-compute[75293]: DEBUG os_brick.utils [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:12:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c3ead6-2d8d-4e1f-a309-04e158db87c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[364d084e-28b3-4eb9-854a-1e4066a3e458]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[34328a22-c6be-4f82-94c2-6dee58bb249b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f93b11-20b0-4e10-a0dc-6e8a029d0f02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:12:38 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:12:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c17ce29-bc18-424c-8ff3-85763e44148f]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG os_brick.utils [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Updating existing volume attachment record: 62db5c36-b224-4cbb-8ac6-92178d850cc4 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:12:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:39 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 is timed out.
Nov 30 07:12:39 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Successfully detached device vdb from instance 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 from the live domain config.
Nov 30 07:12:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZSPGysY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:12:39 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[278e394b-7c40-4ca5-a998-b8085ec3d048]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:12:39 user nova-compute[75293]: No targets found.
Nov 30 07:12:39 user nova-compute[75293]: iSNS:
Nov 30 07:12:39 user nova-compute[75293]: No targets found.
Nov 30 07:12:39 user nova-compute[75293]: STATIC:
Nov 30 07:12:39 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d
Nov 30 07:12:39 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:12:39 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:12:39 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db
Nov 30 07:12:39 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:12:39 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:12:39 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d
Nov 30 07:12:39 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:12:39 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:12:39 user nova-compute[75293]: FIRMWARE:
Nov 30 07:12:39 user nova-compute[75293]: No targets found.
Nov 30 07:12:39 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:12:39 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:12:39 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee1afbe-3e5b-40bf-96e6-e68492473a6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0d9317-5061-462a-abb3-f2d0095bb175]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:12:39 user nova-compute[75293]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:12:39 user nova-compute[75293]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db (non-flash)
Nov 30 07:12:39 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d (non-flash)
Nov 30 07:12:39 user nova-compute[75293]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:12:39 user nova-compute[75293]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db (non-flash)
Nov 30 07:12:39 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe83d4040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d'): ({'sdb'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Removing single pathed devices sdb {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b425432-201f-481a-9610-76c3b2cfa2a4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.108s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab4c361-a75f-4233-b3ee-4e5034555dbc]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Flushing IO for device /dev/sdb {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cab1ade-bac5-4992-9c62-0db00389335c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bfed7c-7ff9-4247-a3ee-447091ffdc7d]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fffef0-1c98-4ce0-9d35-c448661236af]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2924003d-a7ce-4e1f-9d76-2b4c8d55c6ae]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d, portal: 172.16.0.220,3260]
Nov 30 07:12:39 user nova-compute[75293]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d, portal: 172.16.0.220,3260] successful.
Nov 30 07:12:39 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Cleaning up deleted instances {{(pid=75293) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c2fd19-a79e-4b40-8116-072dafa1a09d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94e3193-4034-4703-84ad-cad7c9c3964b]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.563s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] <== disconnect_volume: return (566ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] There are 0 instances to clean {{(pid=75293) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:12:39 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75293) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 07:12:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:45 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:12:45 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:12:47 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:12:47 user nova-compute[75293]: DEBUG nova.objects.instance [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lazy-loading 'flavor' on Instance uuid 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:12:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55db3ff4-2c0d-452f-aa79-2b0ba32fc342 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.414s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:48 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:12:48 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:12:48 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:12:49 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:12:49 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:12:50 user nova-compute[75293]: INFO nova.compute.manager [None req-a52d5326-1697-4ac7-9951-570dc90b17c2 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Unrescuing
Nov 30 07:12:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a52d5326-1697-4ac7-9951-570dc90b17c2 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:12:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a52d5326-1697-4ac7-9951-570dc90b17c2 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquired lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:12:50 user nova-compute[75293]: DEBUG nova.network.neutron [None req-a52d5326-1697-4ac7-9951-570dc90b17c2 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:12:50 user nova-compute[75293]: DEBUG nova.network.neutron [None req-a52d5326-1697-4ac7-9951-570dc90b17c2 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Updating instance_info_cache with network_info: [{"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:12:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a52d5326-1697-4ac7-9951-570dc90b17c2 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Releasing lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:12:50 user nova-compute[75293]: DEBUG nova.objects.instance [None req-a52d5326-1697-4ac7-9951-570dc90b17c2 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lazy-loading 'flavor' on Instance uuid 1b6dee8d-d419-47a3-b2be-4d15e17d6061 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:12:50 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:12:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:50 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:12:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG nova.compute.manager [req-1a0677be-5807-457b-9ba5-25f3cfa20b20 req-0e630bf6-6468-41d3-af30-2e21da14513e service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-vif-unplugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1a0677be-5807-457b-9ba5-25f3cfa20b20 req-0e630bf6-6468-41d3-af30-2e21da14513e service nova] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1a0677be-5807-457b-9ba5-25f3cfa20b20 req-0e630bf6-6468-41d3-af30-2e21da14513e service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1a0677be-5807-457b-9ba5-25f3cfa20b20 req-0e630bf6-6468-41d3-af30-2e21da14513e service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG nova.compute.manager [req-1a0677be-5807-457b-9ba5-25f3cfa20b20 req-0e630bf6-6468-41d3-af30-2e21da14513e service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] No waiting events found dispatching network-vif-unplugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:12:51 user nova-compute[75293]: WARNING nova.compute.manager [req-1a0677be-5807-457b-9ba5-25f3cfa20b20 req-0e630bf6-6468-41d3-af30-2e21da14513e service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received unexpected event network-vif-unplugged-59532faa-7c54-4c8f-ac5f-bea10353a48d for instance with vm_state rescued and task_state unrescuing.
Nov 30 07:12:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZwMXcjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:12:51 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:12:51 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:12:51 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce9f65e-2273-4ca6-9480-e4fed9140c23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:12:51 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3225be-f92e-406b-b2c1-ddc9ecba6d6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5] added
Nov 30 07:12:51 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2805b39d-7df4-4d26-99da-c98b88b2d142]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e06ff0d-6f53-4092-b756-4cce23b131c8]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZwMXcjg {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZwMXcjg" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53b337a-ba50-4180-bffb-50188b0dde78]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hZwMXcjg'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[36208869-ba2e-4025-baab-09ed13bf7057]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2c3207-5369-42d7-80d5-9c381bf3de85]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:12:51 user nova-compute[75293]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db (non-flash)
Nov 30 07:12:51 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:12:51 user nova-compute[75293]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db (non-flash)
Nov 30 07:12:51 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6c324b-027f-42d5-893d-3f393a6d9c45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5, portal: 172.16.0.220,3260]
Nov 30 07:12:51 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5, portal: 172.16.0.220,3260] successful.
Nov 30 07:12:51 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:51 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Instance destroyed successfully.
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[856cb1e2-47b7-4fa4-b391-2f81b0add998]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[73157837-4285-4c38-825a-db5e453fa83a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:12:51 user nova-compute[75293]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db (non-flash)
Nov 30 07:12:51 user nova-compute[75293]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:12:51 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:12:51 user nova-compute[75293]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db (non-flash)
Nov 30 07:12:51 user nova-compute[75293]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:12:51 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b693dd83-b390-4b0c-b7da-baac9daf3876]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:12:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZwMXcjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:12:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:12:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23431346163353337', 'path': '/dev/sdb'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:12:52 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431346163353337', 'path': '/dev/sdb'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:12:52 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lazy-loading 'flavor' on Instance uuid 009f70bc-7561-48fe-ba47-ebaf4d81d462 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:12:52 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:12:52 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:12:52 user nova-compute[75293]:   <source dev="/dev/sdb"/>
Nov 30 07:12:52 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:12:52 user nova-compute[75293]:   <serial>c9bf2351-4111-4c11-b609-97a218ac8ba5</serial>
Nov 30 07:12:52 user nova-compute[75293]: </disk>
Nov 30 07:12:52 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG nova.compute.manager [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG nova.compute.manager [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] No waiting events found dispatching network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:12:53 user nova-compute[75293]: WARNING nova.compute.manager [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received unexpected event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d for instance with vm_state rescued and task_state unrescuing.
Nov 30 07:12:53 user nova-compute[75293]: DEBUG nova.compute.manager [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-changed-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG nova.compute.manager [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Refreshing instance network info cache due to event network-changed-59532faa-7c54-4c8f-ac5f-bea10353a48d. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] Acquiring lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] Acquired lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG nova.network.neutron [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Refreshing network info cache for port 59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] No VIF found with MAC fa:16:3e:79:15:d4, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8e6fade3-626d-4e85-a791-474c8a3bd17a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.810s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG nova.network.neutron [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Updated VIF entry in instance network info cache for port 59532faa-7c54-4c8f-ac5f-bea10353a48d. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG nova.network.neutron [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Updating instance_info_cache with network_info: [{"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] Releasing lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG nova.compute.manager [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-changed-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG nova.compute.manager [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Refreshing instance network info cache due to event network-changed-59532faa-7c54-4c8f-ac5f-bea10353a48d. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] Acquiring lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] Acquired lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG nova.network.neutron [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Refreshing network info cache for port 59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:12:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:54 user nova-compute[75293]: DEBUG nova.network.neutron [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Updated VIF entry in instance network info cache for port 59532faa-7c54-4c8f-ac5f-bea10353a48d. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:12:54 user nova-compute[75293]: DEBUG nova.network.neutron [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Updating instance_info_cache with network_info: [{"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:12:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2dfbce65-1d2b-412a-9253-d9a7517fed10 req-5390d004-5e96-42ad-9665-2e8b69a71cac service nova] Releasing lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:12:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:12:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG nova.compute.manager [req-f380fcb4-b2c0-4cd6-b862-25ea1564735f req-d83496d0-4b05-4452-898c-eafc75f60230 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f380fcb4-b2c0-4cd6-b862-25ea1564735f req-d83496d0-4b05-4452-898c-eafc75f60230 service nova] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f380fcb4-b2c0-4cd6-b862-25ea1564735f req-d83496d0-4b05-4452-898c-eafc75f60230 service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f380fcb4-b2c0-4cd6-b862-25ea1564735f req-d83496d0-4b05-4452-898c-eafc75f60230 service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG nova.compute.manager [req-f380fcb4-b2c0-4cd6-b862-25ea1564735f req-d83496d0-4b05-4452-898c-eafc75f60230 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] No waiting events found dispatching network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:12:55 user nova-compute[75293]: WARNING nova.compute.manager [req-f380fcb4-b2c0-4cd6-b862-25ea1564735f req-d83496d0-4b05-4452-898c-eafc75f60230 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received unexpected event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d for instance with vm_state rescued and task_state unrescuing.
Nov 30 07:12:55 user nova-compute[75293]: DEBUG nova.compute.manager [req-f380fcb4-b2c0-4cd6-b862-25ea1564735f req-d83496d0-4b05-4452-898c-eafc75f60230 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f380fcb4-b2c0-4cd6-b862-25ea1564735f req-d83496d0-4b05-4452-898c-eafc75f60230 service nova] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f380fcb4-b2c0-4cd6-b862-25ea1564735f req-d83496d0-4b05-4452-898c-eafc75f60230 service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f380fcb4-b2c0-4cd6-b862-25ea1564735f req-d83496d0-4b05-4452-898c-eafc75f60230 service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG nova.compute.manager [req-f380fcb4-b2c0-4cd6-b862-25ea1564735f req-d83496d0-4b05-4452-898c-eafc75f60230 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] No waiting events found dispatching network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:12:55 user nova-compute[75293]: WARNING nova.compute.manager [req-f380fcb4-b2c0-4cd6-b862-25ea1564735f req-d83496d0-4b05-4452-898c-eafc75f60230 service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received unexpected event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d for instance with vm_state rescued and task_state unrescuing.
Nov 30 07:12:55 user nova-compute[75293]: INFO nova.compute.manager [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Rebuilding instance
Nov 30 07:12:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG nova.compute.manager [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG nova.compute.manager [None req-a52d5326-1697-4ac7-9951-570dc90b17c2 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG nova.compute.manager [req-0e8bc011-337c-44f3-9bb5-5a53e2542408 req-d7a6a57a-e150-400c-ba9e-e8cb3dad48fb service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Received event network-vif-unplugged-3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0e8bc011-337c-44f3-9bb5-5a53e2542408 req-d7a6a57a-e150-400c-ba9e-e8cb3dad48fb service nova] Acquiring lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0e8bc011-337c-44f3-9bb5-5a53e2542408 req-d7a6a57a-e150-400c-ba9e-e8cb3dad48fb service nova] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0e8bc011-337c-44f3-9bb5-5a53e2542408 req-d7a6a57a-e150-400c-ba9e-e8cb3dad48fb service nova] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG nova.compute.manager [req-0e8bc011-337c-44f3-9bb5-5a53e2542408 req-d7a6a57a-e150-400c-ba9e-e8cb3dad48fb service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] No waiting events found dispatching network-vif-unplugged-3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:12:56 user nova-compute[75293]: WARNING nova.compute.manager [req-0e8bc011-337c-44f3-9bb5-5a53e2542408 req-d7a6a57a-e150-400c-ba9e-e8cb3dad48fb service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Received unexpected event network-vif-unplugged-3d550d68-3322-4126-8dce-9201214e61f8 for instance with vm_state active and task_state rebuilding.
Nov 30 07:12:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:56 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Instance destroyed successfully.
Nov 30 07:12:56 user nova-compute[75293]: INFO nova.compute.manager [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Detaching volume c9bf2351-4111-4c11-b609-97a218ac8ba5
Nov 30 07:12:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:56 user nova-compute[75293]: INFO nova.virt.block_device [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Attempting to driver detach volume c9bf2351-4111-4c11-b609-97a218ac8ba5 from mountpoint /dev/vdb
Nov 30 07:12:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Attempting to detach device vdb from instance 009f70bc-7561-48fe-ba47-ebaf4d81d462 from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:12:56 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:12:56 user nova-compute[75293]:   <source dev="/dev/sdb"/>
Nov 30 07:12:56 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:12:56 user nova-compute[75293]:   <serial>c9bf2351-4111-4c11-b609-97a218ac8ba5</serial>
Nov 30 07:12:56 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:12:56 user nova-compute[75293]: </disk>
Nov 30 07:12:56 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:12:56 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Successfully detached device vdb from instance 009f70bc-7561-48fe-ba47-ebaf4d81d462 from the persistent domain config.
Nov 30 07:12:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZwMXcjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:12:56 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 07:12:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2535a3da-8826-4b27-9560-dc88c9060c9e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:12:56 user nova-compute[75293]: No targets found.
Nov 30 07:12:56 user nova-compute[75293]: iSNS:
Nov 30 07:12:56 user nova-compute[75293]: No targets found.
Nov 30 07:12:56 user nova-compute[75293]: STATIC:
Nov 30 07:12:56 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d
Nov 30 07:12:56 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:12:56 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:12:56 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db
Nov 30 07:12:56 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:12:56 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:12:56 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5
Nov 30 07:12:56 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:12:56 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:12:56 user nova-compute[75293]: FIRMWARE:
Nov 30 07:12:56 user nova-compute[75293]: No targets found.
Nov 30 07:12:56 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:12:56 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:12:56 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec329f38-1c25-4862-91da-ef74dde27ba1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae21afb-bf51-4ed0-9114-6fc55e485520]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:12:57 user nova-compute[75293]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db (non-flash)
Nov 30 07:12:57 user nova-compute[75293]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:12:57 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:12:57 user nova-compute[75293]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db (non-flash)
Nov 30 07:12:57 user nova-compute[75293]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:12:57 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe804dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5'): ({'sdb'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Removing single pathed devices sdb {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2750436-b148-451a-b6b2-8fa2682f67f7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c496c2-5e2a-4701-8a2a-21c7b0342fde]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Flushing IO for device /dev/sdb {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c94ddeb-762b-4062-88ce-dfcb7c16bd3a]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e636cc0-f1f4-4244-bb48-009bfe4f748c]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf29c0a-b515-42c9-af6a-325c7ac92ac8]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e97669-1acc-4a29-b1d7-238652e23706]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5, portal: 172.16.0.220,3260]
Nov 30 07:12:57 user nova-compute[75293]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5, portal: 172.16.0.220,3260] successful.
Nov 30 07:12:57 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a8b539-a9fd-4805-912e-e6064c082950]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] <== disconnect_volume: return (417ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:57 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 251604ac-b300-49ae-ae1a-4543665fead6 is timed out.
Nov 30 07:12:57 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Successfully detached device vdc from instance 251604ac-b300-49ae-ae1a-4543665fead6 from the live domain config.
Nov 30 07:12:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUwBmTQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:12:57 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7941108-a9ef-4785-ac57-da45837258eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:12:57 user nova-compute[75293]: No targets found.
Nov 30 07:12:57 user nova-compute[75293]: iSNS:
Nov 30 07:12:57 user nova-compute[75293]: No targets found.
Nov 30 07:12:57 user nova-compute[75293]: STATIC:
Nov 30 07:12:57 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d
Nov 30 07:12:57 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:12:57 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:12:57 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db
Nov 30 07:12:57 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:12:57 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:12:57 user nova-compute[75293]: FIRMWARE:
Nov 30 07:12:57 user nova-compute[75293]: No targets found.
Nov 30 07:12:57 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:12:57 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:12:57 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b363f6-3164-4c97-b6fe-9fad725730af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[826b66f5-19d7-4e2a-9709-c06261cffc0e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:12:57 user nova-compute[75293]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db (non-flash)
Nov 30 07:12:57 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:12:57 user nova-compute[75293]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db (non-flash)
Nov 30 07:12:57 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effc8635ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db'): ({'sdd'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Removing single pathed devices sdd {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49159c1-5b23-4566-beda-2e92801bcf23]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa402f7-b85f-42c0-b210-548392007c65]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Flushing IO for device /dev/sdd {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dc10cb-1548-4c65-86a7-ef51194c5f1e]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:12:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e194f2-dddf-442f-9d1f-ae94cfcc2714]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.compute.manager [req-54249fb4-7afa-4d9e-8c2f-b6491b76598a req-fec5bbfd-aa24-46a9-b21d-e5a1b5a77fd0 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Received event network-vif-plugged-3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-54249fb4-7afa-4d9e-8c2f-b6491b76598a req-fec5bbfd-aa24-46a9-b21d-e5a1b5a77fd0 service nova] Acquiring lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-54249fb4-7afa-4d9e-8c2f-b6491b76598a req-fec5bbfd-aa24-46a9-b21d-e5a1b5a77fd0 service nova] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-54249fb4-7afa-4d9e-8c2f-b6491b76598a req-fec5bbfd-aa24-46a9-b21d-e5a1b5a77fd0 service nova] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.compute.manager [req-54249fb4-7afa-4d9e-8c2f-b6491b76598a req-fec5bbfd-aa24-46a9-b21d-e5a1b5a77fd0 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] No waiting events found dispatching network-vif-plugged-3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:12:58 user nova-compute[75293]: WARNING nova.compute.manager [req-54249fb4-7afa-4d9e-8c2f-b6491b76598a req-fec5bbfd-aa24-46a9-b21d-e5a1b5a77fd0 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Received unexpected event network-vif-plugged-3d550d68-3322-4126-8dce-9201214e61f8 for instance with vm_state active and task_state rebuilding.
Nov 30 07:12:58 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] SCSI volumes sdd have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:58 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:12:58 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=7645MB free_disk=25.24057388305664GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7579d4-55b8-4ded-897c-57b5325dba19]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a371c2-edbd-462d-b94d-c075776d501e]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db, portal: 172.16.0.220,3260]
Nov 30 07:12:58 user nova-compute[75293]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db, portal: 172.16.0.220,3260] successful.
Nov 30 07:12:58 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd4498f-6a27-4f34-90e3-e80f4a1d16db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3e2e6a-d461-4363-90d0-989fe6582b7b]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.802s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] <== disconnect_volume: return (803ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b6dee8d-d419-47a3-b2be-4d15e17d6061 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b7deb0a-39af-4d93-b93d-5765a731f702 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 061832ab-930a-470b-8b4f-dfc8f19fea6b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 009f70bc-7561-48fe-ba47-ebaf4d81d462 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 251604ac-b300-49ae-ae1a-4543665fead6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance e7b31625-f927-4e52-83d6-93cbc81d6c80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance c8d1df78-2aa2-4710-a570-5f72c60cfc26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Refreshing inventories for resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Updating ProviderTree inventory for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Updating inventory in ProviderTree for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Refreshing aggregate associations for resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa, aggregates: None {{(pid=75293) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Refreshing trait associations for resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV {{(pid=75293) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:12:58 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:12:59 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:12:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.017s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:12:59 user nova-compute[75293]: DEBUG nova.objects.instance [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'flavor' on Instance uuid 251604ac-b300-49ae-ae1a-4543665fead6 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:12:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1100ae53-5b17-41aa-a0ee-4c2d95d72ea5 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "251604ac-b300-49ae-ae1a-4543665fead6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.536s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:00 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:13:00 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:13:00 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:13:00 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:13:00 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Rebuilding the list of instances to heal {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 07:13:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:13:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:13:00 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:13:00 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lazy-loading 'info_cache' on Instance uuid 1b6dee8d-d419-47a3-b2be-4d15e17d6061 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:13:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:01 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Updating instance_info_cache with network_info: [{"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:13:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-1b6dee8d-d419-47a3-b2be-4d15e17d6061" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:13:01 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:13:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:05 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Instance destroyed successfully.
Nov 30 07:13:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-418067200',display_name='tempest-ServerActionsTestOtherA-server-565212846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-418067200',id=14,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2kLa2wHH9ln/DcE1mMyiHO9XBIKOTjYK22BOzhVHg5r0qn+BLS7JnYCSc645GeKcssQgl8lEq/PAj32RkQGtMjm7fEtz2pN4k+1RJtJOqNOhF7RahDUe4ozMYeynwFmw==',key_name='tempest-keypair-1656097843',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:10:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7d94d0308eb444dbdcd3e5c7c21fe79',ramdisk_id='',reservation_id='r-letc0pyj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1263829597',owner_user_name='tempest-ServerActionsTestOtherA-1263829597-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:12:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='917adc7b254e4711ad5f5adbdd2689d4',uuid=009f70bc-7561-48fe-ba47-ebaf4d81d462,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d550d68-3322-4126-8dce-9201214e61f8", "address": "fa:16:3e:79:15:d4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d550d68-33", "ovs_interfaceid": "3d550d68-3322-4126-8dce-9201214e61f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converting VIF {"id": "3d550d68-3322-4126-8dce-9201214e61f8", "address": "fa:16:3e:79:15:d4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d550d68-33", "ovs_interfaceid": "3d550d68-3322-4126-8dce-9201214e61f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:15:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d550d68-3322-4126-8dce-9201214e61f8,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d550d68-33') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG os_vif [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:15:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d550d68-3322-4126-8dce-9201214e61f8,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d550d68-33') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d550d68-33, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11fdfefc-eea8-4935-8262-990f4a6b1566) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:13:05 user nova-compute[75293]: INFO os_vif [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:15:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d550d68-3322-4126-8dce-9201214e61f8,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d550d68-33')
Nov 30 07:13:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZwMXcjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:13:05 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 07:13:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c684c3-6f92-47ca-8f13-0f3c93ce359a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:13:05 user nova-compute[75293]: No targets found.
Nov 30 07:13:05 user nova-compute[75293]: iSNS:
Nov 30 07:13:05 user nova-compute[75293]: No targets found.
Nov 30 07:13:05 user nova-compute[75293]: STATIC:
Nov 30 07:13:05 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d
Nov 30 07:13:05 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:13:05 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:13:05 user nova-compute[75293]: FIRMWARE:
Nov 30 07:13:05 user nova-compute[75293]: No targets found.
Nov 30 07:13:05 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:13:05 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:13:05 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[864a1fe2-2d04-4bea-a462-234ad48ee27e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f97bee5-91aa-4735-bff3-aa8290575cf9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:13:05 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:13:05 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe84d2830>, {}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Disconnecting from: [] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] <== disconnect_volume: return (72ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:13:05 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Deleting instance files /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462_del
Nov 30 07:13:05 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Deletion of /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462_del complete
Nov 30 07:13:05 user nova-compute[75293]: INFO nova.virt.block_device [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Booting with volume c9bf2351-4111-4c11-b609-97a218ac8ba5 at /dev/vdb
Nov 30 07:13:05 user nova-compute[75293]: DEBUG os_brick.utils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5b0f8d-b98e-4d10-8a72-788549ffc998]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f6dddb-1903-484b-853b-162697bf87b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[756cb2eb-87e2-4ccc-a98c-9d8fdaf5375f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[99394c87-6f46-4ac5-8119-135fab84a457]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:13:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:13:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:13:06 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:13:06 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1677a10d-7987-4208-bdb9-4d128745d908]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:13:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:13:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:13:06 user nova-compute[75293]: DEBUG os_brick.utils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:13:06 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Updating existing volume attachment record: bab393a1-2396-4259-b343-d34b4ff07b33 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:13:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:13 user nova-compute[75293]: INFO nova.compute.manager [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Terminating instance
Nov 30 07:13:13 user nova-compute[75293]: DEBUG nova.compute.manager [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:13:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:14 user nova-compute[75293]: DEBUG nova.compute.manager [req-74de026b-b983-4cb5-bcbb-ea27da9021f5 req-298ccfc4-46b1-4201-9908-5e108e12fb6c service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received event network-vif-unplugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:13:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-74de026b-b983-4cb5-bcbb-ea27da9021f5 req-298ccfc4-46b1-4201-9908-5e108e12fb6c service nova] Acquiring lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-74de026b-b983-4cb5-bcbb-ea27da9021f5 req-298ccfc4-46b1-4201-9908-5e108e12fb6c service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-74de026b-b983-4cb5-bcbb-ea27da9021f5 req-298ccfc4-46b1-4201-9908-5e108e12fb6c service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:14 user nova-compute[75293]: DEBUG nova.compute.manager [req-74de026b-b983-4cb5-bcbb-ea27da9021f5 req-298ccfc4-46b1-4201-9908-5e108e12fb6c service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] No waiting events found dispatching network-vif-unplugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:13:14 user nova-compute[75293]: DEBUG nova.compute.manager [req-74de026b-b983-4cb5-bcbb-ea27da9021f5 req-298ccfc4-46b1-4201-9908-5e108e12fb6c service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received event network-vif-unplugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:13:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:14 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Instance destroyed successfully.
Nov 30 07:13:14 user nova-compute[75293]: DEBUG nova.objects.instance [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lazy-loading 'resources' on Instance uuid 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:13:14 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:08:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1186982627',display_name='tempest-TestMinimumBasicScenario-server-1186982627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1186982627',id=10,image_ref='a1bf2a8e-e3eb-4347-ab61-743834e154b1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMsqMmo5y5nrEe5/EAysBz/TZmoUguWfKbQBA8gdmeoccDDnOAjy5UCqnVUy3WWOjscjA4KGhVhWlQXcLk+3JBDwSAjPrQ2phWWgCzGRSuo5bA6deESyxfSvJVRmTiGJw==',key_name='tempest-TestMinimumBasicScenario-1562981580',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:08:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='995a27035c0c4b59b4bc11ef5ed479e7',ramdisk_id='',reservation_id='r-bz3g0w69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a1bf2a8e-e3eb-4347-ab61-743834e154b1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1736397132',owner_user_name='tempest-TestMinimumBasicScenario-1736397132-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:10:33Z,user_data=None,user_id='6c37e36f7b5c4dfe815886140d24ea26',uuid=1d2d8481-7c11-42dd-b60f-0129aa3d3ec8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:13:14 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Converting VIF {"id": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "address": "fa:16:3e:37:51:4d", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd8381e1-d2", "ovs_interfaceid": "fd8381e1-d2ff-4b1c-a6ed-704604abc20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:13:14 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:51:4d,bridge_name='br-int',has_traffic_filtering=True,id=fd8381e1-d2ff-4b1c-a6ed-704604abc20d,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd8381e1-d2') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:13:14 user nova-compute[75293]: DEBUG os_vif [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:51:4d,bridge_name='br-int',has_traffic_filtering=True,id=fd8381e1-d2ff-4b1c-a6ed-704604abc20d,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd8381e1-d2') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:13:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd8381e1-d2, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:13:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab87a89d-3d2f-448b-8947-b2ac74bfc06c) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:13:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:13:14 user nova-compute[75293]: INFO os_vif [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:51:4d,bridge_name='br-int',has_traffic_filtering=True,id=fd8381e1-d2ff-4b1c-a6ed-704604abc20d,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd8381e1-d2')
Nov 30 07:13:14 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Deleting instance files /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8_del
Nov 30 07:13:14 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Deletion of /opt/stack/data/nova/instances/1d2d8481-7c11-42dd-b60f-0129aa3d3ec8_del complete
Nov 30 07:13:14 user nova-compute[75293]: INFO nova.compute.manager [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 30 07:13:14 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:13:14 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:13:14 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:13:15 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Creating image(s)
Nov 30 07:13:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "/opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "/opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "/opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-410c05d3-fb27-41d9-8d13-72cd8140d68c req-779d2439-a8c0-4c51-a030-3a61789788d8 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received event network-vif-deleted-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:13:15 user nova-compute[75293]: INFO nova.compute.manager [req-410c05d3-fb27-41d9-8d13-72cd8140d68c req-779d2439-a8c0-4c51-a030-3a61789788d8 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Neutron deleted interface fd8381e1-d2ff-4b1c-a6ed-704604abc20d; detaching it from the instance and deleting it from the info cache
Nov 30 07:13:15 user nova-compute[75293]: DEBUG nova.network.neutron [req-410c05d3-fb27-41d9-8d13-72cd8140d68c req-779d2439-a8c0-4c51-a030-3a61789788d8 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:13:15 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Took 0.88 seconds to deallocate network for instance.
Nov 30 07:13:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-410c05d3-fb27-41d9-8d13-72cd8140d68c req-779d2439-a8c0-4c51-a030-3a61789788d8 service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Detach interface failed, port_id=fd8381e1-d2ff-4b1c-a6ed-704604abc20d, reason: Instance 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8 could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.185s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.177s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk 1073741824" returned: 0 in 0.068s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:13:15 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.208s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Checking if we can resize image /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:16 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Deleted allocations for instance 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.compute.manager [req-8ee34791-c6c8-462d-b792-b57924bd071d req-b22dae07-a1bc-40f5-bf93-7989be9c271c service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received event network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8ee34791-c6c8-462d-b792-b57924bd071d req-b22dae07-a1bc-40f5-bf93-7989be9c271c service nova] Acquiring lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8ee34791-c6c8-462d-b792-b57924bd071d req-b22dae07-a1bc-40f5-bf93-7989be9c271c service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8ee34791-c6c8-462d-b792-b57924bd071d req-b22dae07-a1bc-40f5-bf93-7989be9c271c service nova] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.compute.manager [req-8ee34791-c6c8-462d-b792-b57924bd071d req-b22dae07-a1bc-40f5-bf93-7989be9c271c service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] No waiting events found dispatching network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:13:16 user nova-compute[75293]: WARNING nova.compute.manager [req-8ee34791-c6c8-462d-b792-b57924bd071d req-b22dae07-a1bc-40f5-bf93-7989be9c271c service nova] [instance: 1d2d8481-7c11-42dd-b60f-0129aa3d3ec8] Received unexpected event network-vif-plugged-fd8381e1-d2ff-4b1c-a6ed-704604abc20d for instance with vm_state deleted and task_state None.
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e960e4f5-6134-4def-8a67-883f8b74bd72 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "1d2d8481-7c11-42dd-b60f-0129aa3d3ec8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.513s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Cannot resize image /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Ensure instance console log exists: /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Start _get_guest_xml network_info=[{"id": "3d550d68-3322-4126-8dce-9201214e61f8", "address": "fa:16:3e:79:15:d4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d550d68-33", "ovs_interfaceid": "3d550d68-3322-4126-8dce-9201214e61f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZwMXcjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '009f70bc-7561-48fe-ba47-ebaf4d81d462', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9bf2351-4111-4c11-b609-97a218ac8ba5', 'serial': 'c9bf2351-4111-4c11-b609-97a218ac8ba5'}, 'delete_on_termination': False, 'attachment_id': 'bab393a1-2396-4259-b343-d34b4ff07b33', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:13:16 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 07:13:16 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.objects.instance [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lazy-loading 'vcpu_model' on Instance uuid 009f70bc-7561-48fe-ba47-ebaf4d81d462 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZwMXcjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:13:16 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:13:16 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:13:16 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cfc8a1-15d4-407c-a1ea-1952c64b0c1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:13:16 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[288243ad-f47c-4a85-b2ea-7e6d5f51c61d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5] added
Nov 30 07:13:16 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0e6b5d-13b6-47be-9bc6-8948f8c2c582]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e0fa6e-1f16-4c28-ae5f-e413d9f148e0]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZwMXcjg {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZwMXcjg" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7952976a-a1fa-428c-9bf1-bcbb67f3148e]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hZwMXcjg'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e503725-b810-43f6-9d1b-d3da87c4c445]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6577c89d-ad87-466f-ba34-3ce221e6f6bc]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de9ddcda-e75f-4a08-82a0-f794e35c98aa (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725c8d57-2ca7-442b-8f0e-24df62e245e1 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:13:16 user nova-compute[75293]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de9ddcda-e75f-4a08-82a0-f794e35c98aa (non-flash)
Nov 30 07:13:16 user nova-compute[75293]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725c8d57-2ca7-442b-8f0e-24df62e245e1 (non-flash)
Nov 30 07:13:16 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:13:16 user nova-compute[75293]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de9ddcda-e75f-4a08-82a0-f794e35c98aa (non-flash)
Nov 30 07:13:16 user nova-compute[75293]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725c8d57-2ca7-442b-8f0e-24df62e245e1 (non-flash)
Nov 30 07:13:16 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4369ac00-8f5a-4974-874d-b04cd15bf21d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5, portal: 172.16.0.220,3260]
Nov 30 07:13:16 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5, portal: 172.16.0.220,3260] successful.
Nov 30 07:13:16 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0975a9db-a964-49e0-8433-eb15450e6c1b]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c365e198-5c95-459a-bb6c-93bbf18bc1db]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de9ddcda-e75f-4a08-82a0-f794e35c98aa (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725c8d57-2ca7-442b-8f0e-24df62e245e1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:13:16 user nova-compute[75293]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de9ddcda-e75f-4a08-82a0-f794e35c98aa (non-flash)
Nov 30 07:13:16 user nova-compute[75293]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725c8d57-2ca7-442b-8f0e-24df62e245e1 (non-flash)
Nov 30 07:13:16 user nova-compute[75293]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:13:16 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:13:16 user nova-compute[75293]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de9ddcda-e75f-4a08-82a0-f794e35c98aa (non-flash)
Nov 30 07:13:16 user nova-compute[75293]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:725c8d57-2ca7-442b-8f0e-24df62e245e1 (non-flash)
Nov 30 07:13:16 user nova-compute[75293]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:13:16 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f6d815-094b-4be4-9d13-8b40240feff4]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:16 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: None {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZwMXcjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23431346163353337', 'path': '/dev/sde'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431346163353337', 'path': '/dev/sde'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T07:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-418067200',display_name='tempest-ServerActionsTestOtherA-server-565212846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-418067200',id=14,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2kLa2wHH9ln/DcE1mMyiHO9XBIKOTjYK22BOzhVHg5r0qn+BLS7JnYCSc645GeKcssQgl8lEq/PAj32RkQGtMjm7fEtz2pN4k+1RJtJOqNOhF7RahDUe4ozMYeynwFmw==',key_name='tempest-keypair-1656097843',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:10:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7d94d0308eb444dbdcd3e5c7c21fe79',ramdisk_id='',reservation_id='r-letc0pyj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1263829597',owner_user_name='tempest-ServerActionsTestOtherA-1263829597-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:13:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='917adc7b254e4711ad5f5adbdd2689d4',uuid=009f70bc-7561-48fe-ba47-ebaf4d81d462,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d550d68-3322-4126-8dce-9201214e61f8", "address": "fa:16:3e:79:15:d4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d550d68-33", "ovs_interfaceid": "3d550d68-3322-4126-8dce-9201214e61f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converting VIF {"id": "3d550d68-3322-4126-8dce-9201214e61f8", "address": "fa:16:3e:79:15:d4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d550d68-33", "ovs_interfaceid": "3d550d68-3322-4126-8dce-9201214e61f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:15:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d550d68-3322-4126-8dce-9201214e61f8,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d550d68-33') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:13:17 user nova-compute[75293]:   <uuid>009f70bc-7561-48fe-ba47-ebaf4d81d462</uuid>
Nov 30 07:13:17 user nova-compute[75293]:   <name>instance-0000000e</name>
Nov 30 07:13:17 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:13:17 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:13:17 user nova-compute[75293]:   <metadata>
Nov 30 07:13:17 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:13:17 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:13:17 user nova-compute[75293]:       <nova:name>tempest-ServerActionsTestOtherA-server-565212846</nova:name>
Nov 30 07:13:17 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:13:16</nova:creationTime>
Nov 30 07:13:17 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:13:17 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:13:17 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:13:17 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:13:17 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:13:17 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:13:17 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:13:17 user nova-compute[75293]:       <nova:owner>
Nov 30 07:13:17 user nova-compute[75293]:         <nova:user uuid="917adc7b254e4711ad5f5adbdd2689d4">tempest-ServerActionsTestOtherA-1263829597-project-member</nova:user>
Nov 30 07:13:17 user nova-compute[75293]:         <nova:project uuid="b7d94d0308eb444dbdcd3e5c7c21fe79">tempest-ServerActionsTestOtherA-1263829597</nova:project>
Nov 30 07:13:17 user nova-compute[75293]:       </nova:owner>
Nov 30 07:13:17 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:13:17 user nova-compute[75293]:       <nova:ports>
Nov 30 07:13:17 user nova-compute[75293]:         <nova:port uuid="3d550d68-3322-4126-8dce-9201214e61f8">
Nov 30 07:13:17 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 07:13:17 user nova-compute[75293]:         </nova:port>
Nov 30 07:13:17 user nova-compute[75293]:       </nova:ports>
Nov 30 07:13:17 user nova-compute[75293]:     </nova:instance>
Nov 30 07:13:17 user nova-compute[75293]:   </metadata>
Nov 30 07:13:17 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:13:17 user nova-compute[75293]:     <system>
Nov 30 07:13:17 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:13:17 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:13:17 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:13:17 user nova-compute[75293]:       <entry name="serial">009f70bc-7561-48fe-ba47-ebaf4d81d462</entry>
Nov 30 07:13:17 user nova-compute[75293]:       <entry name="uuid">009f70bc-7561-48fe-ba47-ebaf4d81d462</entry>
Nov 30 07:13:17 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:13:17 user nova-compute[75293]:     </system>
Nov 30 07:13:17 user nova-compute[75293]:   </sysinfo>
Nov 30 07:13:17 user nova-compute[75293]:   <os>
Nov 30 07:13:17 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:13:17 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:13:17 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:13:17 user nova-compute[75293]:   </os>
Nov 30 07:13:17 user nova-compute[75293]:   <features>
Nov 30 07:13:17 user nova-compute[75293]:     <acpi/>
Nov 30 07:13:17 user nova-compute[75293]:     <apic/>
Nov 30 07:13:17 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:13:17 user nova-compute[75293]:   </features>
Nov 30 07:13:17 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:13:17 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:13:17 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:13:17 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:13:17 user nova-compute[75293]:   </clock>
Nov 30 07:13:17 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:13:17 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:13:17 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:13:17 user nova-compute[75293]:   </cpu>
Nov 30 07:13:17 user nova-compute[75293]:   <devices>
Nov 30 07:13:17 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:13:17 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:13:17 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk"/>
Nov 30 07:13:17 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:13:17 user nova-compute[75293]:     </disk>
Nov 30 07:13:17 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:13:17 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:13:17 user nova-compute[75293]:       <source dev="/dev/sde"/>
Nov 30 07:13:17 user nova-compute[75293]:       <target dev="vdb" bus="virtio"/>
Nov 30 07:13:17 user nova-compute[75293]:       <serial>c9bf2351-4111-4c11-b609-97a218ac8ba5</serial>
Nov 30 07:13:17 user nova-compute[75293]:     </disk>
Nov 30 07:13:17 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:13:17 user nova-compute[75293]:       <mac address="fa:16:3e:79:15:d4"/>
Nov 30 07:13:17 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:13:17 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:13:17 user nova-compute[75293]:       <target dev="tap3d550d68-33"/>
Nov 30 07:13:17 user nova-compute[75293]:     </interface>
Nov 30 07:13:17 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:13:17 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/console.log" append="off"/>
Nov 30 07:13:17 user nova-compute[75293]:     </serial>
Nov 30 07:13:17 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:13:17 user nova-compute[75293]:     <video>
Nov 30 07:13:17 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:13:17 user nova-compute[75293]:     </video>
Nov 30 07:13:17 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:13:17 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:13:17 user nova-compute[75293]:     </rng>
Nov 30 07:13:17 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:13:17 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:13:17 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:13:17 user nova-compute[75293]:     </memballoon>
Nov 30 07:13:17 user nova-compute[75293]:   </devices>
Nov 30 07:13:17 user nova-compute[75293]: </domain>
Nov 30 07:13:17 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T07:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-418067200',display_name='tempest-ServerActionsTestOtherA-server-565212846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-418067200',id=14,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2kLa2wHH9ln/DcE1mMyiHO9XBIKOTjYK22BOzhVHg5r0qn+BLS7JnYCSc645GeKcssQgl8lEq/PAj32RkQGtMjm7fEtz2pN4k+1RJtJOqNOhF7RahDUe4ozMYeynwFmw==',key_name='tempest-keypair-1656097843',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:10:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7d94d0308eb444dbdcd3e5c7c21fe79',ramdisk_id='',reservation_id='r-letc0pyj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1263829597',owner_user_name='tempest-ServerActionsTestOtherA-1263829597-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:13:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='917adc7b254e4711ad5f5adbdd2689d4',uuid=009f70bc-7561-48fe-ba47-ebaf4d81d462,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d550d68-3322-4126-8dce-9201214e61f8", "address": "fa:16:3e:79:15:d4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d550d68-33", "ovs_interfaceid": "3d550d68-3322-4126-8dce-9201214e61f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converting VIF {"id": "3d550d68-3322-4126-8dce-9201214e61f8", "address": "fa:16:3e:79:15:d4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d550d68-33", "ovs_interfaceid": "3d550d68-3322-4126-8dce-9201214e61f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:15:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d550d68-3322-4126-8dce-9201214e61f8,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d550d68-33') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG os_vif [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:15:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d550d68-3322-4126-8dce-9201214e61f8,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d550d68-33') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32111a97-3d5d-56fa-8b29-e6664aa314e8', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d550d68-33, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d550d68-33, col_values=(('qos', UUID('1faf4cbf-e59f-4b91-a49d-b1ffdec1b85b')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d550d68-33, col_values=(('external_ids', {'iface-id': '3d550d68-3322-4126-8dce-9201214e61f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:15:d4', 'vm-uuid': '009f70bc-7561-48fe-ba47-ebaf4d81d462'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:17 user nova-compute[75293]: INFO os_vif [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:15:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d550d68-3322-4126-8dce-9201214e61f8,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d550d68-33')
Nov 30 07:13:17 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._sync_power_states {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:13:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] No VIF found with MAC fa:16:3e:79:15:d4, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG nova.compute.manager [req-fba6f4cc-dfe6-4f2b-8dd2-00ae666936a6 req-5eac5c03-bce3-42f2-bf13-c14bda11d0c2 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Received event network-vif-plugged-3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fba6f4cc-dfe6-4f2b-8dd2-00ae666936a6 req-5eac5c03-bce3-42f2-bf13-c14bda11d0c2 service nova] Acquiring lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fba6f4cc-dfe6-4f2b-8dd2-00ae666936a6 req-5eac5c03-bce3-42f2-bf13-c14bda11d0c2 service nova] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fba6f4cc-dfe6-4f2b-8dd2-00ae666936a6 req-5eac5c03-bce3-42f2-bf13-c14bda11d0c2 service nova] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG nova.compute.manager [req-fba6f4cc-dfe6-4f2b-8dd2-00ae666936a6 req-5eac5c03-bce3-42f2-bf13-c14bda11d0c2 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] No waiting events found dispatching network-vif-plugged-3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:13:19 user nova-compute[75293]: WARNING nova.compute.manager [req-fba6f4cc-dfe6-4f2b-8dd2-00ae666936a6 req-5eac5c03-bce3-42f2-bf13-c14bda11d0c2 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Received unexpected event network-vif-plugged-3d550d68-3322-4126-8dce-9201214e61f8 for instance with vm_state active and task_state rebuild_spawning.
Nov 30 07:13:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Triggering sync for uuid 1b6dee8d-d419-47a3-b2be-4d15e17d6061 {{(pid=75293) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Triggering sync for uuid 1b7deb0a-39af-4d93-b93d-5765a731f702 {{(pid=75293) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Triggering sync for uuid 251604ac-b300-49ae-ae1a-4543665fead6 {{(pid=75293) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Triggering sync for uuid 061832ab-930a-470b-8b4f-dfc8f19fea6b {{(pid=75293) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Triggering sync for uuid 009f70bc-7561-48fe-ba47-ebaf4d81d462 {{(pid=75293) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Triggering sync for uuid e7b31625-f927-4e52-83d6-93cbc81d6c80 {{(pid=75293) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Triggering sync for uuid c8d1df78-2aa2-4710-a570-5f72c60cfc26 {{(pid=75293) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Triggering sync for uuid 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64 {{(pid=75293) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "1b7deb0a-39af-4d93-b93d-5765a731f702" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "1b7deb0a-39af-4d93-b93d-5765a731f702" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "251604ac-b300-49ae-ae1a-4543665fead6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "251604ac-b300-49ae-ae1a-4543665fead6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "061832ab-930a-470b-8b4f-dfc8f19fea6b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "009f70bc-7561-48fe-ba47-ebaf4d81d462" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:19 user nova-compute[75293]: INFO nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "e7b31625-f927-4e52-83d6-93cbc81d6c80" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "e7b31625-f927-4e52-83d6-93cbc81d6c80" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "251604ac-b300-49ae-ae1a-4543665fead6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "1b7deb0a-39af-4d93-b93d-5765a731f702" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.140s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "e7b31625-f927-4e52-83d6-93cbc81d6c80" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.164s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.163s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "061832ab-930a-470b-8b4f-dfc8f19fea6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "061832ab-930a-470b-8b4f-dfc8f19fea6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:20 user nova-compute[75293]: INFO nova.compute.manager [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Terminating instance
Nov 30 07:13:20 user nova-compute[75293]: DEBUG nova.compute.manager [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.compute.manager [req-b2e17849-b4d3-433a-8f05-cbbc95bf9f78 req-f93a9733-102b-42d5-9764-59ea28ab0586 service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Received event network-vif-unplugged-693d3de2-b91f-4efb-9e5e-2281d858ec0b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b2e17849-b4d3-433a-8f05-cbbc95bf9f78 req-f93a9733-102b-42d5-9764-59ea28ab0586 service nova] Acquiring lock "061832ab-930a-470b-8b4f-dfc8f19fea6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b2e17849-b4d3-433a-8f05-cbbc95bf9f78 req-f93a9733-102b-42d5-9764-59ea28ab0586 service nova] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b2e17849-b4d3-433a-8f05-cbbc95bf9f78 req-f93a9733-102b-42d5-9764-59ea28ab0586 service nova] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.compute.manager [req-b2e17849-b4d3-433a-8f05-cbbc95bf9f78 req-f93a9733-102b-42d5-9764-59ea28ab0586 service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] No waiting events found dispatching network-vif-unplugged-693d3de2-b91f-4efb-9e5e-2281d858ec0b {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.compute.manager [req-b2e17849-b4d3-433a-8f05-cbbc95bf9f78 req-f93a9733-102b-42d5-9764-59ea28ab0586 service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Received event network-vif-unplugged-693d3de2-b91f-4efb-9e5e-2281d858ec0b for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.compute.manager [req-84f158ce-139b-4dfe-905f-b2a13c82b221 req-1827e22e-6340-4d8c-98bc-5d638537026f service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Received event network-vif-plugged-3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-84f158ce-139b-4dfe-905f-b2a13c82b221 req-1827e22e-6340-4d8c-98bc-5d638537026f service nova] Acquiring lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-84f158ce-139b-4dfe-905f-b2a13c82b221 req-1827e22e-6340-4d8c-98bc-5d638537026f service nova] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-84f158ce-139b-4dfe-905f-b2a13c82b221 req-1827e22e-6340-4d8c-98bc-5d638537026f service nova] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.compute.manager [req-84f158ce-139b-4dfe-905f-b2a13c82b221 req-1827e22e-6340-4d8c-98bc-5d638537026f service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] No waiting events found dispatching network-vif-plugged-3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:13:21 user nova-compute[75293]: WARNING nova.compute.manager [req-84f158ce-139b-4dfe-905f-b2a13c82b221 req-1827e22e-6340-4d8c-98bc-5d638537026f service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Received unexpected event network-vif-plugged-3d550d68-3322-4126-8dce-9201214e61f8 for instance with vm_state active and task_state rebuild_spawning.
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.compute.manager [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:13:21 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Instance spawned successfully.
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.compute.manager [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.objects.instance [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75293) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 30 07:13:21 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Instance destroyed successfully.
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.objects.instance [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lazy-loading 'resources' on Instance uuid 061832ab-930a-470b-8b4f-dfc8f19fea6b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-102239067',display_name='tempest-VolumesAdminNegativeTest-server-102239067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-102239067',id=6,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACU6svB3YUMbNXIz/g7yGwOGofvLSdRzbQ+0xWSRtwQ0cZ7gAJYQyYxnEvAColQINlEJ9gNredWz6zWyN6EbMTtSNFJBZVxxAbqU3rHzA09mnSlfhATReQwh/oT5LkxDQ==',key_name='tempest-keypair-2033360921',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:07:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba486b18243b4462a2a4c35b6c478a0a',ramdisk_id='',reservation_id='r-ptt1l5ow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1001198017',owner_user_name='tempest-VolumesAdminNegativeTest-1001198017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:07:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a489452874654d99ba7f7b68eb62d30b',uuid=061832ab-930a-470b-8b4f-dfc8f19fea6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "address": "fa:16:3e:0a:7f:0a", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693d3de2-b9", "ovs_interfaceid": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Converting VIF {"id": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "address": "fa:16:3e:0a:7f:0a", "network": {"id": "43e6a947-eef6-4e52-afaf-c2defb3200b5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-144863469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba486b18243b4462a2a4c35b6c478a0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693d3de2-b9", "ovs_interfaceid": "693d3de2-b91f-4efb-9e5e-2281d858ec0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:7f:0a,bridge_name='br-int',has_traffic_filtering=True,id=693d3de2-b91f-4efb-9e5e-2281d858ec0b,network=Network(43e6a947-eef6-4e52-afaf-c2defb3200b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693d3de2-b9') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG os_vif [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:7f:0a,bridge_name='br-int',has_traffic_filtering=True,id=693d3de2-b91f-4efb-9e5e-2281d858ec0b,network=Network(43e6a947-eef6-4e52-afaf-c2defb3200b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693d3de2-b9') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap693d3de2-b9, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5babd1df-9c68-47ce-8be6-9e67ccb3f113) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:13:21 user nova-compute[75293]: INFO os_vif [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:7f:0a,bridge_name='br-int',has_traffic_filtering=True,id=693d3de2-b91f-4efb-9e5e-2281d858ec0b,network=Network(43e6a947-eef6-4e52-afaf-c2defb3200b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693d3de2-b9')
Nov 30 07:13:21 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Deleting instance files /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b_del
Nov 30 07:13:21 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Deletion of /opt/stack/data/nova/instances/061832ab-930a-470b-8b4f-dfc8f19fea6b_del complete
Nov 30 07:13:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7940d678-28b2-48e4-bb41-59b371902720 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.129s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:21 user nova-compute[75293]: INFO nova.compute.manager [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 30 07:13:21 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:13:21 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:13:22 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:13:22 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Took 0.83 seconds to deallocate network for instance.
Nov 30 07:13:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:23 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:13:23 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:13:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:23 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Deleted allocations for instance 061832ab-930a-470b-8b4f-dfc8f19fea6b
Nov 30 07:13:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fd25cb59-b435-4ea4-9a3d-70e45d08a7fb tempest-VolumesAdminNegativeTest-1001198017 tempest-VolumesAdminNegativeTest-1001198017-project-member] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.373s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:23 user nova-compute[75293]: DEBUG nova.compute.manager [req-0e6d48d6-18d9-48b4-a9c3-1132757ae8d8 req-8e1e4d1c-f55f-4d0c-b7f5-a2598b6c2022 service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Received event network-vif-plugged-693d3de2-b91f-4efb-9e5e-2281d858ec0b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:13:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0e6d48d6-18d9-48b4-a9c3-1132757ae8d8 req-8e1e4d1c-f55f-4d0c-b7f5-a2598b6c2022 service nova] Acquiring lock "061832ab-930a-470b-8b4f-dfc8f19fea6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0e6d48d6-18d9-48b4-a9c3-1132757ae8d8 req-8e1e4d1c-f55f-4d0c-b7f5-a2598b6c2022 service nova] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0e6d48d6-18d9-48b4-a9c3-1132757ae8d8 req-8e1e4d1c-f55f-4d0c-b7f5-a2598b6c2022 service nova] Lock "061832ab-930a-470b-8b4f-dfc8f19fea6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:23 user nova-compute[75293]: DEBUG nova.compute.manager [req-0e6d48d6-18d9-48b4-a9c3-1132757ae8d8 req-8e1e4d1c-f55f-4d0c-b7f5-a2598b6c2022 service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] No waiting events found dispatching network-vif-plugged-693d3de2-b91f-4efb-9e5e-2281d858ec0b {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:13:23 user nova-compute[75293]: WARNING nova.compute.manager [req-0e6d48d6-18d9-48b4-a9c3-1132757ae8d8 req-8e1e4d1c-f55f-4d0c-b7f5-a2598b6c2022 service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Received unexpected event network-vif-plugged-693d3de2-b91f-4efb-9e5e-2281d858ec0b for instance with vm_state deleted and task_state None.
Nov 30 07:13:23 user nova-compute[75293]: DEBUG nova.compute.manager [req-acbb5420-8c49-4e91-86e7-a165a3d14444 req-ed1d3bd4-8be1-47ad-b073-6fa76eb73baf service nova] [instance: 061832ab-930a-470b-8b4f-dfc8f19fea6b] Received event network-vif-deleted-693d3de2-b91f-4efb-9e5e-2281d858ec0b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:13:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:24 user nova-compute[75293]: INFO nova.compute.manager [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Detaching volume 5d80efc0-d30e-4484-a572-3839e3e01f8d
Nov 30 07:13:24 user nova-compute[75293]: INFO nova.virt.block_device [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Attempting to driver detach volume 5d80efc0-d30e-4484-a572-3839e3e01f8d from mountpoint /dev/vdb
Nov 30 07:13:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Attempting to detach device vdb from instance 1b6dee8d-d419-47a3-b2be-4d15e17d6061 from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:13:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:13:24 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:13:24 user nova-compute[75293]:   <source dev="/dev/sdc"/>
Nov 30 07:13:24 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:13:24 user nova-compute[75293]:   <serial>5d80efc0-d30e-4484-a572-3839e3e01f8d</serial>
Nov 30 07:13:24 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:13:24 user nova-compute[75293]: </disk>
Nov 30 07:13:24 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:13:24 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Successfully detached device vdb from instance 1b6dee8d-d419-47a3-b2be-4d15e17d6061 from the persistent domain config.
Nov 30 07:13:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1b6dee8d-d419-47a3-b2be-4d15e17d6061 from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:13:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:13:24 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:13:24 user nova-compute[75293]:   <source dev="/dev/sdc"/>
Nov 30 07:13:24 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:13:24 user nova-compute[75293]:   <serial>5d80efc0-d30e-4484-a572-3839e3e01f8d</serial>
Nov 30 07:13:24 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:13:24 user nova-compute[75293]: </disk>
Nov 30 07:13:24 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:13:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1b6dee8d-d419-47a3-b2be-4d15e17d6061 {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:13:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "251604ac-b300-49ae-ae1a-4543665fead6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "251604ac-b300-49ae-ae1a-4543665fead6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "251604ac-b300-49ae-ae1a-4543665fead6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:27 user nova-compute[75293]: INFO nova.compute.manager [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Terminating instance
Nov 30 07:13:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:13:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:27 user nova-compute[75293]: DEBUG nova.compute.manager [req-de72e995-564c-40f1-a4b6-97c560b7a0a7 req-4730a192-f7e2-4fb2-a7a6-5e31a9694813 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received event network-vif-unplugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:13:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-de72e995-564c-40f1-a4b6-97c560b7a0a7 req-4730a192-f7e2-4fb2-a7a6-5e31a9694813 service nova] Acquiring lock "251604ac-b300-49ae-ae1a-4543665fead6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-de72e995-564c-40f1-a4b6-97c560b7a0a7 req-4730a192-f7e2-4fb2-a7a6-5e31a9694813 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-de72e995-564c-40f1-a4b6-97c560b7a0a7 req-4730a192-f7e2-4fb2-a7a6-5e31a9694813 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:27 user nova-compute[75293]: DEBUG nova.compute.manager [req-de72e995-564c-40f1-a4b6-97c560b7a0a7 req-4730a192-f7e2-4fb2-a7a6-5e31a9694813 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] No waiting events found dispatching network-vif-unplugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:13:27 user nova-compute[75293]: DEBUG nova.compute.manager [req-de72e995-564c-40f1-a4b6-97c560b7a0a7 req-4730a192-f7e2-4fb2-a7a6-5e31a9694813 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received event network-vif-unplugged-7cf6968f-9b43-4e24-9ade-d296716616fe for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:13:28 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Instance destroyed successfully.
Nov 30 07:13:28 user nova-compute[75293]: DEBUG nova.objects.instance [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'resources' on Instance uuid 251604ac-b300-49ae-ae1a-4543665fead6 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:13:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T07:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1720061760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1720061760',id=3,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmznsMjyME+bFayB3TzkgHrsSuO5TgKvjxqc/rUuOyL/QpV4coa/hjsQhBDMiu/ZZazrEo74EbBS+0CeSXDTbH3pDd0GHSp57yUHop6vH4ahe2AH3WPMcQ4QoMkQZr2Cw==',key_name='tempest-keypair-466117858',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:11:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18aa2f5bea3d44ecb10ff083d6f76038',ramdisk_id='',reservation_id='r-8g0ngsgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-763079906',owner_user_name='tempest-AttachVolumeShelveTestJSON-763079906-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e385a89f913645dd9fd2770e6e7445da',uuid=251604ac-b300-49ae-ae1a-4543665fead6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:13:28 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converting VIF {"id": "7cf6968f-9b43-4e24-9ade-d296716616fe", "address": "fa:16:3e:1e:ec:42", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf6968f-9b", "ovs_interfaceid": "7cf6968f-9b43-4e24-9ade-d296716616fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:13:28 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=7cf6968f-9b43-4e24-9ade-d296716616fe,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf6968f-9b') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:13:28 user nova-compute[75293]: DEBUG os_vif [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=7cf6968f-9b43-4e24-9ade-d296716616fe,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf6968f-9b') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:13:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cf6968f-9b, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:13:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:13:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2831c75e-3a3e-4aec-8638-63caae0fa514) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:13:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:28 user nova-compute[75293]: INFO os_vif [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ec:42,bridge_name='br-int',has_traffic_filtering=True,id=7cf6968f-9b43-4e24-9ade-d296716616fe,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf6968f-9b')
Nov 30 07:13:28 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Deleting instance files /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6_del
Nov 30 07:13:28 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Deletion of /opt/stack/data/nova/instances/251604ac-b300-49ae-ae1a-4543665fead6_del complete
Nov 30 07:13:28 user nova-compute[75293]: INFO nova.compute.manager [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 30 07:13:28 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:13:28 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:13:28 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:13:29 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:13:29 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Took 1.05 seconds to deallocate network for instance.
Nov 30 07:13:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-d8f5254b-0f06-43ca-8ad7-c3a54dd8a6fb req-3bf10083-936c-42e6-9ddc-8fe9c4093226 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received event network-vif-deleted-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:13:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:29 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:13:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-0cb4fbd0-67b0-43cc-8298-93c1b79a8d17 req-3aeb77ed-3dd9-44cc-b28a-5431207626c4 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received event network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:13:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0cb4fbd0-67b0-43cc-8298-93c1b79a8d17 req-3aeb77ed-3dd9-44cc-b28a-5431207626c4 service nova] Acquiring lock "251604ac-b300-49ae-ae1a-4543665fead6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0cb4fbd0-67b0-43cc-8298-93c1b79a8d17 req-3aeb77ed-3dd9-44cc-b28a-5431207626c4 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0cb4fbd0-67b0-43cc-8298-93c1b79a8d17 req-3aeb77ed-3dd9-44cc-b28a-5431207626c4 service nova] Lock "251604ac-b300-49ae-ae1a-4543665fead6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-0cb4fbd0-67b0-43cc-8298-93c1b79a8d17 req-3aeb77ed-3dd9-44cc-b28a-5431207626c4 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] No waiting events found dispatching network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:13:29 user nova-compute[75293]: WARNING nova.compute.manager [req-0cb4fbd0-67b0-43cc-8298-93c1b79a8d17 req-3aeb77ed-3dd9-44cc-b28a-5431207626c4 service nova] [instance: 251604ac-b300-49ae-ae1a-4543665fead6] Received unexpected event network-vif-plugged-7cf6968f-9b43-4e24-9ade-d296716616fe for instance with vm_state deleted and task_state None.
Nov 30 07:13:29 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:13:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:29 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Deleted allocations for instance 251604ac-b300-49ae-ae1a-4543665fead6
Nov 30 07:13:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-da1ee117-8741-41d2-8db4-8db5aa612bed tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "251604ac-b300-49ae-ae1a-4543665fead6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.672s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:13:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75293) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 07:13:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:13:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:13:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Acquiring lock "e7b31625-f927-4e52-83d6-93cbc81d6c80" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "e7b31625-f927-4e52-83d6-93cbc81d6c80" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG nova.objects.instance [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lazy-loading 'flavor' on Instance uuid e7b31625-f927-4e52-83d6-93cbc81d6c80 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "e7b31625-f927-4e52-83d6-93cbc81d6c80" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Acquiring lock "e7b31625-f927-4e52-83d6-93cbc81d6c80" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "e7b31625-f927-4e52-83d6-93cbc81d6c80" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:43 user nova-compute[75293]: INFO nova.compute.manager [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Attaching volume c0169123-ad4a-453a-a3ac-0247b2114f81 to /dev/vdb
Nov 30 07:13:43 user nova-compute[75293]: DEBUG os_brick.utils [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acd5177-d4b6-48d1-8a2a-79cc0fa3786c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6793444-8d7f-43d4-9928-4054b5415c65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[63893821-ebce-44ab-983b-9a6d0a7b0e48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79b511d-67fd-4342-9bbe-b95021812db7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:13:43 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:13:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4625da8b-cad5-42ba-863c-6ead21677999]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG os_brick.utils [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:13:43 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Updating existing volume attachment record: e4fc002f-3cbc-430e-8bc7-f125c658a3b9 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:13:44 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1b6dee8d-d419-47a3-b2be-4d15e17d6061 is timed out.
Nov 30 07:13:44 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Successfully detached device vdb from instance 1b6dee8d-d419-47a3-b2be-4d15e17d6061 from the live domain config.
Nov 30 07:13:44 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qyovIDVz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:13:44 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e685792-2cf4-4d4f-9115-c8760c658f4d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:13:44 user nova-compute[75293]: No targets found.
Nov 30 07:13:44 user nova-compute[75293]: iSNS:
Nov 30 07:13:44 user nova-compute[75293]: No targets found.
Nov 30 07:13:44 user nova-compute[75293]: STATIC:
Nov 30 07:13:44 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d
Nov 30 07:13:44 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:13:44 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:13:44 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5
Nov 30 07:13:44 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:13:44 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:13:44 user nova-compute[75293]: FIRMWARE:
Nov 30 07:13:44 user nova-compute[75293]: No targets found.
Nov 30 07:13:44 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:13:44 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:13:44 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[64470b0e-3c9a-41e7-889c-441a4a23c1e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f2afff-e258-428c-a364-8d57d191656c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:13:44 user nova-compute[75293]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:13:44 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d (non-flash)
Nov 30 07:13:44 user nova-compute[75293]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:13:44 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe83c16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d'): ({'sdc'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Removing single pathed devices sdc {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80ee053-ff3f-455e-935e-01198050ce1e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d23421-d6a6-49e1-a4af-a226eed7ab48]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Flushing IO for device /dev/sdc {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19e79d3-a8b4-4ec8-9999-1a550a38aad7]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[65421c9c-c630-46b2-a1bc-9b52c1395c0a]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6669d24-41a0-4539-84dc-9135f89e05df]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[580be064-8f81-4718-94d2-5595a4ba3444]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d, portal: 172.16.0.220,3260]
Nov 30 07:13:44 user nova-compute[75293]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d, portal: 172.16.0.220,3260] successful.
Nov 30 07:13:44 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d80efc0-d30e-4484-a572-3839e3e01f8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79211b7-a2a6-4ddb-a15f-5737545f452c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] <== disconnect_volume: return (312ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:13:44 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:13:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:47 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:13:47 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:13:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:48 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:13:49 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:13:50 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:13:50 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:13:50 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:13:50 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:13:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:50 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:13:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:13:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUYrHQRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:13:52 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:13:52 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:13:52 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b299b9-3956-44e3-bd37-7636619d3d81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:13:52 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf7f04f-acd7-4fc9-a9ee-ce2fc0b9d508]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81] added
Nov 30 07:13:52 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[89432107-ad51-4dff-b051-dd9a7220f315]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[88477bb8-dd36-4993-8858-6fc30378fba1]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUYrHQRL {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUYrHQRL" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9b6378-7fd9-489a-be19-b1e21ddf6436]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gUYrHQRL'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b519b4cb-4e8f-4b89-8d16-0c63ec315220]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d97f30d-76be-4fb1-8ddb-061ab44d8527]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:13:52 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:13:52 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[316455e5-96c0-47ea-94e2-e3eb723d5496]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81, portal: 172.16.0.220,3260]
Nov 30 07:13:52 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81, portal: 172.16.0.220,3260] successful.
Nov 30 07:13:52 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea56933-3ddf-4d3d-aacb-eb2bcd64c7fe]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[16df4869-c229-46ce-ac59-16b960ca1f51]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:13:52 user nova-compute[75293]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 (non-flash)
Nov 30 07:13:52 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:13:52 user nova-compute[75293]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 (non-flash)
Nov 30 07:13:52 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8e630d-ac42-41aa-96b0-c0cec8893ede]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUYrHQRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.486s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] <== connect_volume: return (1490ms) {'type': 'block', 'scsi_wwn': '23238613362373838', 'path': '/dev/sdb'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238613362373838', 'path': '/dev/sdb'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:13:53 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:13:53 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:13:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=7770MB free_disk=25.273269653320312GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG nova.objects.instance [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lazy-loading 'flavor' on Instance uuid e7b31625-f927-4e52-83d6-93cbc81d6c80 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:13:53 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:13:53 user nova-compute[75293]:   <source dev="/dev/sdb"/>
Nov 30 07:13:53 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:13:53 user nova-compute[75293]:   <serial>c0169123-ad4a-453a-a3ac-0247b2114f81</serial>
Nov 30 07:13:53 user nova-compute[75293]: </disk>
Nov 30 07:13:53 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b6dee8d-d419-47a3-b2be-4d15e17d6061 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b7deb0a-39af-4d93-b93d-5765a731f702 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 009f70bc-7561-48fe-ba47-ebaf4d81d462 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance e7b31625-f927-4e52-83d6-93cbc81d6c80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance c8d1df78-2aa2-4710-a570-5f72c60cfc26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:13:53 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:13:54 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:13:54 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:13:54 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:13:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:13:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:13:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] No VIF found with MAC fa:16:3e:1b:a2:50, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:13:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9d7ca402-ed67-4720-afe3-bed017f66d2f tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "e7b31625-f927-4e52-83d6-93cbc81d6c80" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.137s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:55 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:13:55 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:13:55 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:13:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-1b7deb0a-39af-4d93-b93d-5765a731f702" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:13:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-1b7deb0a-39af-4d93-b93d-5765a731f702" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:13:55 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:13:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Acquiring lock "e7b31625-f927-4e52-83d6-93cbc81d6c80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "e7b31625-f927-4e52-83d6-93cbc81d6c80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Acquiring lock "e7b31625-f927-4e52-83d6-93cbc81d6c80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "e7b31625-f927-4e52-83d6-93cbc81d6c80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "e7b31625-f927-4e52-83d6-93cbc81d6c80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:55 user nova-compute[75293]: INFO nova.compute.manager [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Terminating instance
Nov 30 07:13:55 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:13:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:55 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Updating instance_info_cache with network_info: [{"id": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "address": "fa:16:3e:bb:63:ac", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f5514b-92", "ovs_interfaceid": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:13:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-1b7deb0a-39af-4d93-b93d-5765a731f702" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:13:55 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:13:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:56 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Instance destroyed successfully.
Nov 30 07:13:56 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lazy-loading 'resources' on Instance uuid e7b31625-f927-4e52-83d6-93cbc81d6c80 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-175661468',display_name='tempest-DeleteServersTestJSON-server-175661468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-175661468',id=15,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:11:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa2a531931f94fb491608b4bd3251e7a',ramdisk_id='',reservation_id='r-9spyy1so',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-492841832',owner_user_name='tempest-DeleteServersTestJSON-492841832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:11:56Z,user_data=None,user_id='7e39fb27fce54653a80942b11407b3d0',uuid=e7b31625-f927-4e52-83d6-93cbc81d6c80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4613d21e-e71c-41e4-a386-adba5c84c717", "address": "fa:16:3e:1b:a2:50", "network": {"id": "e86d6458-aba9-4a8c-bec8-f2c68384b848", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1143901742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2a531931f94fb491608b4bd3251e7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4613d21e-e7", "ovs_interfaceid": "4613d21e-e71c-41e4-a386-adba5c84c717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Converting VIF {"id": "4613d21e-e71c-41e4-a386-adba5c84c717", "address": "fa:16:3e:1b:a2:50", "network": {"id": "e86d6458-aba9-4a8c-bec8-f2c68384b848", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1143901742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa2a531931f94fb491608b4bd3251e7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4613d21e-e7", "ovs_interfaceid": "4613d21e-e71c-41e4-a386-adba5c84c717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a2:50,bridge_name='br-int',has_traffic_filtering=True,id=4613d21e-e71c-41e4-a386-adba5c84c717,network=Network(e86d6458-aba9-4a8c-bec8-f2c68384b848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4613d21e-e7') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_vif [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a2:50,bridge_name='br-int',has_traffic_filtering=True,id=4613d21e-e71c-41e4-a386-adba5c84c717,network=Network(e86d6458-aba9-4a8c-bec8-f2c68384b848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4613d21e-e7') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4613d21e-e7, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0ed905c-8e42-4640-9c12-17cbb154abef) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:13:56 user nova-compute[75293]: INFO os_vif [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a2:50,bridge_name='br-int',has_traffic_filtering=True,id=4613d21e-e71c-41e4-a386-adba5c84c717,network=Network(e86d6458-aba9-4a8c-bec8-f2c68384b848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4613d21e-e7')
Nov 30 07:13:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUYrHQRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:13:56 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f351185-01ec-4faa-b598-ca5e81aa6ab5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:13:56 user nova-compute[75293]: No targets found.
Nov 30 07:13:56 user nova-compute[75293]: iSNS:
Nov 30 07:13:56 user nova-compute[75293]: No targets found.
Nov 30 07:13:56 user nova-compute[75293]: STATIC:
Nov 30 07:13:56 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5
Nov 30 07:13:56 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:13:56 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:13:56 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81
Nov 30 07:13:56 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:13:56 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:13:56 user nova-compute[75293]: FIRMWARE:
Nov 30 07:13:56 user nova-compute[75293]: No targets found.
Nov 30 07:13:56 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:13:56 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:13:56 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd48425-2bbb-47cc-ba4a-ed4f33d56f43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdafdeb-3d89-4955-bba5-253af188ae70]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:13:56 user nova-compute[75293]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 (non-flash)
Nov 30 07:13:56 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:13:56 user nova-compute[75293]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 (non-flash)
Nov 30 07:13:56 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe82aa050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81'): ({'sdb'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Removing single pathed devices sdb {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d3c647-a621-4e24-aa76-76cb1d3532c6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[247b2d60-f3ae-4f27-887a-3b0f7ef1910a]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Flushing IO for device /dev/sdb {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b518f7c-d6df-4605-a494-664d5c917e6b]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dec643-9e93-4ec7-8c7d-1f7e78d90406]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.042s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab96ac0-72a1-43e6-8a31-b119da91f528]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7173a676-941b-4df4-aa93-c3123f60b5ef]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81, portal: 172.16.0.220,3260]
Nov 30 07:13:56 user nova-compute[75293]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81, portal: 172.16.0.220,3260] successful.
Nov 30 07:13:56 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0169123-ad4a-453a-a3ac-0247b2114f81 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead33cfd-a269-43d9-a7d3-5b4e75f624d3]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] <== disconnect_volume: return (347ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:13:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:13:56 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Deleting instance files /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80_del
Nov 30 07:13:56 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Deletion of /opt/stack/data/nova/instances/e7b31625-f927-4e52-83d6-93cbc81d6c80_del complete
Nov 30 07:13:57 user nova-compute[75293]: INFO nova.compute.manager [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 30 07:13:57 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:13:57 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:13:57 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:13:57 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:13:57 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Took 0.52 seconds to deallocate network for instance.
Nov 30 07:13:57 user nova-compute[75293]: DEBUG nova.compute.manager [req-6eda527c-59b1-4335-967d-dbd3c8072325 req-20e1e0d0-d815-4a82-807c-db32a06e43c9 service nova] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Received event network-vif-deleted-4613d21e-e71c-41e4-a386-adba5c84c717 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:13:58 user nova-compute[75293]: INFO nova.compute.manager [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] [instance: e7b31625-f927-4e52-83d6-93cbc81d6c80] Took 0.87 seconds to detach 1 volumes for instance.
Nov 30 07:13:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:13:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:13:58 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:13:58 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:13:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:58 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Deleted allocations for instance e7b31625-f927-4e52-83d6-93cbc81d6c80
Nov 30 07:13:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8ea0cde0-bb34-4e5b-8d26-5e6fa9d833c3 tempest-DeleteServersTestJSON-492841832 tempest-DeleteServersTestJSON-492841832-project-member] Lock "e7b31625-f927-4e52-83d6-93cbc81d6c80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.097s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:13:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:02 user nova-compute[75293]: DEBUG nova.objects.instance [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lazy-loading 'flavor' on Instance uuid 1b6dee8d-d419-47a3-b2be-4d15e17d6061 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:14:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f41ed2e0-894d-4d39-8aa8-4e8812e78158 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 38.430s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "9295d423-d71c-436b-9306-e0b386a0011f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "9295d423-d71c-436b-9306-e0b386a0011f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:07 user nova-compute[75293]: DEBUG nova.compute.manager [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:14:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:14:08 user nova-compute[75293]: INFO nova.compute.claims [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Claim successful on node user
Nov 30 07:14:08 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:14:08 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:14:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:08 user nova-compute[75293]: DEBUG nova.compute.manager [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:14:08 user nova-compute[75293]: DEBUG nova.compute.manager [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:14:08 user nova-compute[75293]: DEBUG nova.network.neutron [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:14:08 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:14:08 user nova-compute[75293]: DEBUG nova.compute.manager [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:14:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:08 user nova-compute[75293]: DEBUG nova.policy [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c37e36f7b5c4dfe815886140d24ea26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '995a27035c0c4b59b4bc11ef5ed479e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:14:08 user nova-compute[75293]: DEBUG nova.compute.manager [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:14:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:14:08 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Creating image(s)
Nov 30 07:14:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "/opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "/opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "/opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "bd27d71b238f5b8f71ba38fd5f553386bc12f49e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "bd27d71b238f5b8f71ba38fd5f553386bc12f49e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd27d71b238f5b8f71ba38fd5f553386bc12f49e.part --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd27d71b238f5b8f71ba38fd5f553386bc12f49e.part --force-share --output=json" returned: 0 in 0.218s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:09 user nova-compute[75293]: DEBUG nova.virt.images [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] 01bc1251-0d5f-4ede-a6bd-abbef2cf058c was qcow2, converting to raw {{(pid=75293) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 07:14:09 user nova-compute[75293]: DEBUG nova.privsep.utils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75293) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 07:14:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bd27d71b238f5b8f71ba38fd5f553386bc12f49e.part /opt/stack/data/nova/instances/_base/bd27d71b238f5b8f71ba38fd5f553386bc12f49e.converted {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:09 user nova-compute[75293]: DEBUG nova.network.neutron [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Successfully created port: 4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:14:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bd27d71b238f5b8f71ba38fd5f553386bc12f49e.part /opt/stack/data/nova/instances/_base/bd27d71b238f5b8f71ba38fd5f553386bc12f49e.converted" returned: 0 in 0.588s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd27d71b238f5b8f71ba38fd5f553386bc12f49e.converted --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd27d71b238f5b8f71ba38fd5f553386bc12f49e.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "bd27d71b238f5b8f71ba38fd5f553386bc12f49e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.512s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd27d71b238f5b8f71ba38fd5f553386bc12f49e --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd27d71b238f5b8f71ba38fd5f553386bc12f49e --force-share --output=json" returned: 0 in 0.201s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "bd27d71b238f5b8f71ba38fd5f553386bc12f49e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "bd27d71b238f5b8f71ba38fd5f553386bc12f49e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd27d71b238f5b8f71ba38fd5f553386bc12f49e --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd27d71b238f5b8f71ba38fd5f553386bc12f49e --force-share --output=json" returned: 0 in 0.204s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd27d71b238f5b8f71ba38fd5f553386bc12f49e,backing_fmt=raw /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd27d71b238f5b8f71ba38fd5f553386bc12f49e,backing_fmt=raw /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk 1073741824" returned: 0 in 0.053s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "bd27d71b238f5b8f71ba38fd5f553386bc12f49e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd27d71b238f5b8f71ba38fd5f553386bc12f49e --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd27d71b238f5b8f71ba38fd5f553386bc12f49e --force-share --output=json" returned: 0 in 0.179s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:10 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:14:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Cannot resize image /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Ensure instance console log exists: /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG nova.network.neutron [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Successfully updated port: 4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquired lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG nova.network.neutron [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-bb813ed4-5f68-4ebe-a428-93e8e64d806d req-bc4b88fb-6b63-484b-8289-71469f5ae220 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received event network-changed-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-bb813ed4-5f68-4ebe-a428-93e8e64d806d req-bc4b88fb-6b63-484b-8289-71469f5ae220 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Refreshing instance network info cache due to event network-changed-4367d997-9d95-45a9-9a95-ddb8a27595c6. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-bb813ed4-5f68-4ebe-a428-93e8e64d806d req-bc4b88fb-6b63-484b-8289-71469f5ae220 service nova] Acquiring lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG nova.network.neutron [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG nova.network.neutron [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Updating instance_info_cache with network_info: [{"id": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "address": "fa:16:3e:93:db:1e", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4367d997-9d", "ovs_interfaceid": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Releasing lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG nova.compute.manager [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Instance network_info: |[{"id": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "address": "fa:16:3e:93:db:1e", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4367d997-9d", "ovs_interfaceid": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-bb813ed4-5f68-4ebe-a428-93e8e64d806d req-bc4b88fb-6b63-484b-8289-71469f5ae220 service nova] Acquired lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG nova.network.neutron [req-bb813ed4-5f68-4ebe-a428-93e8e64d806d req-bc4b88fb-6b63-484b-8289-71469f5ae220 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Refreshing network info cache for port 4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:14:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Start _get_guest_xml network_info=[{"id": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "address": "fa:16:3e:93:db:1e", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4367d997-9d", "ovs_interfaceid": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:14:05Z,direct_url=<?>,disk_format='qcow2',id=01bc1251-0d5f-4ede-a6bd-abbef2cf058c,min_disk=0,min_ram=0,name='tempest-scenario-img--1942196560',owner='995a27035c0c4b59b4bc11ef5ed479e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:14:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '01bc1251-0d5f-4ede-a6bd-abbef2cf058c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:14:12 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:14:12 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:14:05Z,direct_url=<?>,disk_format='qcow2',id=01bc1251-0d5f-4ede-a6bd-abbef2cf058c,min_disk=0,min_ram=0,name='tempest-scenario-img--1942196560',owner='995a27035c0c4b59b4bc11ef5ed479e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:14:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1812462465',display_name='tempest-TestMinimumBasicScenario-server-1812462465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1812462465',id=18,image_ref='01bc1251-0d5f-4ede-a6bd-abbef2cf058c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGM8RAkZ2JZRI8v4gPf85M8NNY1FgdCrAHhat5E90+q6+Ji/L6jj0KbdjG1v2GzxdNdf3Br+yyDZhSTkfDh9NlrsciRV88oMuE3Vly4qEb1BQZ31txgr8Dfqj2cQH/t03g==',key_name='tempest-TestMinimumBasicScenario-768959219',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='995a27035c0c4b59b4bc11ef5ed479e7',ramdisk_id='',reservation_id='r-xknvg9uq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01bc1251-0d5f-4ede-a6bd-abbef2cf058c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1736397132',owner_user_name='tempest-TestMinimumBasicScenario-1736397132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:14:09Z,user_data=None,user_id='6c37e36f7b5c4dfe815886140d24ea26',uuid=9295d423-d71c-436b-9306-e0b386a0011f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "address": "fa:16:3e:93:db:1e", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4367d997-9d", "ovs_interfaceid": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Converting VIF {"id": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "address": "fa:16:3e:93:db:1e", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4367d997-9d", "ovs_interfaceid": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:db:1e,bridge_name='br-int',has_traffic_filtering=True,id=4367d997-9d95-45a9-9a95-ddb8a27595c6,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4367d997-9d') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.objects.instance [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lazy-loading 'pci_devices' on Instance uuid 9295d423-d71c-436b-9306-e0b386a0011f {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:14:12 user nova-compute[75293]:   <uuid>9295d423-d71c-436b-9306-e0b386a0011f</uuid>
Nov 30 07:14:12 user nova-compute[75293]:   <name>instance-00000012</name>
Nov 30 07:14:12 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:14:12 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:14:12 user nova-compute[75293]:   <metadata>
Nov 30 07:14:12 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:14:12 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:14:12 user nova-compute[75293]:       <nova:name>tempest-TestMinimumBasicScenario-server-1812462465</nova:name>
Nov 30 07:14:12 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:14:12</nova:creationTime>
Nov 30 07:14:12 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:14:12 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:14:12 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:14:12 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:14:12 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:14:12 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:14:12 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:14:12 user nova-compute[75293]:       <nova:owner>
Nov 30 07:14:12 user nova-compute[75293]:         <nova:user uuid="6c37e36f7b5c4dfe815886140d24ea26">tempest-TestMinimumBasicScenario-1736397132-project-member</nova:user>
Nov 30 07:14:12 user nova-compute[75293]:         <nova:project uuid="995a27035c0c4b59b4bc11ef5ed479e7">tempest-TestMinimumBasicScenario-1736397132</nova:project>
Nov 30 07:14:12 user nova-compute[75293]:       </nova:owner>
Nov 30 07:14:12 user nova-compute[75293]:       <nova:root type="image" uuid="01bc1251-0d5f-4ede-a6bd-abbef2cf058c"/>
Nov 30 07:14:12 user nova-compute[75293]:       <nova:ports>
Nov 30 07:14:12 user nova-compute[75293]:         <nova:port uuid="4367d997-9d95-45a9-9a95-ddb8a27595c6">
Nov 30 07:14:12 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 07:14:12 user nova-compute[75293]:         </nova:port>
Nov 30 07:14:12 user nova-compute[75293]:       </nova:ports>
Nov 30 07:14:12 user nova-compute[75293]:     </nova:instance>
Nov 30 07:14:12 user nova-compute[75293]:   </metadata>
Nov 30 07:14:12 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:14:12 user nova-compute[75293]:     <system>
Nov 30 07:14:12 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:14:12 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:14:12 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:14:12 user nova-compute[75293]:       <entry name="serial">9295d423-d71c-436b-9306-e0b386a0011f</entry>
Nov 30 07:14:12 user nova-compute[75293]:       <entry name="uuid">9295d423-d71c-436b-9306-e0b386a0011f</entry>
Nov 30 07:14:12 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:14:12 user nova-compute[75293]:     </system>
Nov 30 07:14:12 user nova-compute[75293]:   </sysinfo>
Nov 30 07:14:12 user nova-compute[75293]:   <os>
Nov 30 07:14:12 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:14:12 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:14:12 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:14:12 user nova-compute[75293]:   </os>
Nov 30 07:14:12 user nova-compute[75293]:   <features>
Nov 30 07:14:12 user nova-compute[75293]:     <acpi/>
Nov 30 07:14:12 user nova-compute[75293]:     <apic/>
Nov 30 07:14:12 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:14:12 user nova-compute[75293]:   </features>
Nov 30 07:14:12 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:14:12 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:14:12 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:14:12 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:14:12 user nova-compute[75293]:   </clock>
Nov 30 07:14:12 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:14:12 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:14:12 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:14:12 user nova-compute[75293]:   </cpu>
Nov 30 07:14:12 user nova-compute[75293]:   <devices>
Nov 30 07:14:12 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:14:12 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:14:12 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk"/>
Nov 30 07:14:12 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:14:12 user nova-compute[75293]:     </disk>
Nov 30 07:14:12 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:14:12 user nova-compute[75293]:       <mac address="fa:16:3e:93:db:1e"/>
Nov 30 07:14:12 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:14:12 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:14:12 user nova-compute[75293]:       <target dev="tap4367d997-9d"/>
Nov 30 07:14:12 user nova-compute[75293]:     </interface>
Nov 30 07:14:12 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:14:12 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/console.log" append="off"/>
Nov 30 07:14:12 user nova-compute[75293]:     </serial>
Nov 30 07:14:12 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:14:12 user nova-compute[75293]:     <video>
Nov 30 07:14:12 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:14:12 user nova-compute[75293]:     </video>
Nov 30 07:14:12 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:14:12 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:14:12 user nova-compute[75293]:     </rng>
Nov 30 07:14:12 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:14:12 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:14:12 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:14:12 user nova-compute[75293]:     </memballoon>
Nov 30 07:14:12 user nova-compute[75293]:   </devices>
Nov 30 07:14:12 user nova-compute[75293]: </domain>
Nov 30 07:14:12 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1812462465',display_name='tempest-TestMinimumBasicScenario-server-1812462465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1812462465',id=18,image_ref='01bc1251-0d5f-4ede-a6bd-abbef2cf058c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGM8RAkZ2JZRI8v4gPf85M8NNY1FgdCrAHhat5E90+q6+Ji/L6jj0KbdjG1v2GzxdNdf3Br+yyDZhSTkfDh9NlrsciRV88oMuE3Vly4qEb1BQZ31txgr8Dfqj2cQH/t03g==',key_name='tempest-TestMinimumBasicScenario-768959219',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='995a27035c0c4b59b4bc11ef5ed479e7',ramdisk_id='',reservation_id='r-xknvg9uq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01bc1251-0d5f-4ede-a6bd-abbef2cf058c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1736397132',owner_user_name='tempest-TestMinimumBasicScenario-1736397132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:14:09Z,user_data=None,user_id='6c37e36f7b5c4dfe815886140d24ea26',uuid=9295d423-d71c-436b-9306-e0b386a0011f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "address": "fa:16:3e:93:db:1e", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4367d997-9d", "ovs_interfaceid": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Converting VIF {"id": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "address": "fa:16:3e:93:db:1e", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4367d997-9d", "ovs_interfaceid": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:db:1e,bridge_name='br-int',has_traffic_filtering=True,id=4367d997-9d95-45a9-9a95-ddb8a27595c6,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4367d997-9d') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG os_vif [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:db:1e,bridge_name='br-int',has_traffic_filtering=True,id=4367d997-9d95-45a9-9a95-ddb8a27595c6,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4367d997-9d') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4812615d-ebc0-514a-b01c-b8a6a9d9eae3', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4367d997-9d, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4367d997-9d, col_values=(('qos', UUID('2971ee0e-d869-4f2a-ac0b-17600b39e118')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4367d997-9d, col_values=(('external_ids', {'iface-id': '4367d997-9d95-45a9-9a95-ddb8a27595c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:db:1e', 'vm-uuid': '9295d423-d71c-436b-9306-e0b386a0011f'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:12 user nova-compute[75293]: INFO os_vif [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:db:1e,bridge_name='br-int',has_traffic_filtering=True,id=4367d997-9d95-45a9-9a95-ddb8a27595c6,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4367d997-9d')
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] No VIF found with MAC fa:16:3e:93:db:1e, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.network.neutron [req-bb813ed4-5f68-4ebe-a428-93e8e64d806d req-bc4b88fb-6b63-484b-8289-71469f5ae220 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Updated VIF entry in instance network info cache for port 4367d997-9d95-45a9-9a95-ddb8a27595c6. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG nova.network.neutron [req-bb813ed4-5f68-4ebe-a428-93e8e64d806d req-bc4b88fb-6b63-484b-8289-71469f5ae220 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Updating instance_info_cache with network_info: [{"id": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "address": "fa:16:3e:93:db:1e", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4367d997-9d", "ovs_interfaceid": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:14:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-bb813ed4-5f68-4ebe-a428-93e8e64d806d req-bc4b88fb-6b63-484b-8289-71469f5ae220 service nova] Releasing lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:14:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG nova.compute.manager [req-08bda9a9-efa7-4f69-a559-2764a1a283c5 req-1f3953cb-ab45-4e42-a4f4-6d58adeb7645 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received event network-vif-plugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-08bda9a9-efa7-4f69-a559-2764a1a283c5 req-1f3953cb-ab45-4e42-a4f4-6d58adeb7645 service nova] Acquiring lock "9295d423-d71c-436b-9306-e0b386a0011f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-08bda9a9-efa7-4f69-a559-2764a1a283c5 req-1f3953cb-ab45-4e42-a4f4-6d58adeb7645 service nova] Lock "9295d423-d71c-436b-9306-e0b386a0011f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-08bda9a9-efa7-4f69-a559-2764a1a283c5 req-1f3953cb-ab45-4e42-a4f4-6d58adeb7645 service nova] Lock "9295d423-d71c-436b-9306-e0b386a0011f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG nova.compute.manager [req-08bda9a9-efa7-4f69-a559-2764a1a283c5 req-1f3953cb-ab45-4e42-a4f4-6d58adeb7645 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] No waiting events found dispatching network-vif-plugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:14:14 user nova-compute[75293]: WARNING nova.compute.manager [req-08bda9a9-efa7-4f69-a559-2764a1a283c5 req-1f3953cb-ab45-4e42-a4f4-6d58adeb7645 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received unexpected event network-vif-plugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 for instance with vm_state building and task_state spawning.
Nov 30 07:14:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "677602ec-88fd-4026-8112-8469855f8a78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "677602ec-88fd-4026-8112-8469855f8a78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:14:14 user nova-compute[75293]: INFO nova.compute.claims [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Claim successful on node user
Nov 30 07:14:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:14 user nova-compute[75293]: INFO nova.compute.manager [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Terminating instance
Nov 30 07:14:14 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:14:15 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:14:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-e3a12b1f-0602-4df8-a1e6-7db3d2004279 req-fca59de8-1996-4cea-9a25-4713868a823d service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-vif-unplugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e3a12b1f-0602-4df8-a1e6-7db3d2004279 req-fca59de8-1996-4cea-9a25-4713868a823d service nova] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e3a12b1f-0602-4df8-a1e6-7db3d2004279 req-fca59de8-1996-4cea-9a25-4713868a823d service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e3a12b1f-0602-4df8-a1e6-7db3d2004279 req-fca59de8-1996-4cea-9a25-4713868a823d service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-e3a12b1f-0602-4df8-a1e6-7db3d2004279 req-fca59de8-1996-4cea-9a25-4713868a823d service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] No waiting events found dispatching network-vif-unplugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-e3a12b1f-0602-4df8-a1e6-7db3d2004279 req-fca59de8-1996-4cea-9a25-4713868a823d service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-vif-unplugged-59532faa-7c54-4c8f-ac5f-bea10353a48d for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:14:15 user nova-compute[75293]: INFO nova.virt.block_device [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Booting with volume 9f2b1463-7536-4ea8-9576-419ceeeb8314 at /dev/vda
Nov 30 07:14:15 user nova-compute[75293]: DEBUG nova.policy [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1470bbdb1f494cca880294d2e97d3a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb68dc3daea04910bc7f11d6acdd91a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG os_brick.utils [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d02e21-1f90-466f-8874-0210fae74784]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69eaeea-4e7b-48d4-a723-9be6de9cbbe5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cb1f8b-0927-4fd8-a72f-a9bac6c4256d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d330f77-7dff-41e0-8931-e0d0005be43d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:15 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Instance destroyed successfully.
Nov 30 07:14:15 user nova-compute[75293]: DEBUG nova.objects.instance [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lazy-loading 'resources' on Instance uuid 1b6dee8d-d419-47a3-b2be-4d15e17d6061 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:14:15 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6f0d48-5242-4ddf-b2d4-1634220808bc]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG os_brick.utils [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Updating existing volume attachment record: 2d35d94a-fead-4f69-85b0-bcbcc8a46f4e {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1726376547',display_name='tempest-ServerStableDeviceRescueTest-server-1726376547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1726376547',id=1,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2zqZqO0QK157+eSrLkJyxdVIfoBSFfpmYkPAeb8ikJKX0k4XMkh5q0M3TM7YT5CDeOyMhl/SU18f6cdJzqIgDsuiIfH9NGqE4O4Mw8kvIb2EixuK2eyb5uN/WJbVm++Q==',key_name='tempest-keypair-1570503927',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:11:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d19ade0f478e4fa09780686118f9155c',ramdisk_id='',reservation_id='r-l5vpvaom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-786185367',owner_user_name='tempest-ServerStableDeviceRescueTest-786185367-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dfa6fb751d6425f93feabaa8402cd81',uuid=1b6dee8d-d419-47a3-b2be-4d15e17d6061,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Converting VIF {"id": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "address": "fa:16:3e:c6:2c:81", "network": {"id": "e405aa5a-b440-40a0-bec7-796676ed00a8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1189799719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19ade0f478e4fa09780686118f9155c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59532faa-7c", "ovs_interfaceid": "59532faa-7c54-4c8f-ac5f-bea10353a48d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=59532faa-7c54-4c8f-ac5f-bea10353a48d,network=Network(e405aa5a-b440-40a0-bec7-796676ed00a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59532faa-7c') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG os_vif [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=59532faa-7c54-4c8f-ac5f-bea10353a48d,network=Network(e405aa5a-b440-40a0-bec7-796676ed00a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59532faa-7c') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59532faa-7c, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0f4ff07-8fc9-4523-a22b-43bf62f46d9c) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:15 user nova-compute[75293]: INFO os_vif [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=59532faa-7c54-4c8f-ac5f-bea10353a48d,network=Network(e405aa5a-b440-40a0-bec7-796676ed00a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59532faa-7c')
Nov 30 07:14:15 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Deleting instance files /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061_del
Nov 30 07:14:15 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Deletion of /opt/stack/data/nova/instances/1b6dee8d-d419-47a3-b2be-4d15e17d6061_del complete
Nov 30 07:14:15 user nova-compute[75293]: INFO nova.compute.manager [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 30 07:14:15 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Successfully created port: 814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG nova.compute.manager [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:14:16 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Instance spawned successfully.
Nov 30 07:14:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:16 user nova-compute[75293]: INFO nova.compute.manager [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Took 7.70 seconds to spawn the instance on the hypervisor.
Nov 30 07:14:16 user nova-compute[75293]: DEBUG nova.compute.manager [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:14:16 user nova-compute[75293]: INFO nova.compute.manager [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Took 8.45 seconds to build instance.
Nov 30 07:14:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4715ec6d-19d9-4c64-acd9-18ae5521f0a9 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "9295d423-d71c-436b-9306-e0b386a0011f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.561s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG nova.compute.manager [req-83388aa4-d4a9-4665-9967-4d8448437472 req-243a100d-e9a2-4e1f-9412-33d98f3c3a9d service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received event network-vif-plugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-83388aa4-d4a9-4665-9967-4d8448437472 req-243a100d-e9a2-4e1f-9412-33d98f3c3a9d service nova] Acquiring lock "9295d423-d71c-436b-9306-e0b386a0011f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-83388aa4-d4a9-4665-9967-4d8448437472 req-243a100d-e9a2-4e1f-9412-33d98f3c3a9d service nova] Lock "9295d423-d71c-436b-9306-e0b386a0011f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-83388aa4-d4a9-4665-9967-4d8448437472 req-243a100d-e9a2-4e1f-9412-33d98f3c3a9d service nova] Lock "9295d423-d71c-436b-9306-e0b386a0011f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG nova.compute.manager [req-83388aa4-d4a9-4665-9967-4d8448437472 req-243a100d-e9a2-4e1f-9412-33d98f3c3a9d service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] No waiting events found dispatching network-vif-plugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:14:16 user nova-compute[75293]: WARNING nova.compute.manager [req-83388aa4-d4a9-4665-9967-4d8448437472 req-243a100d-e9a2-4e1f-9412-33d98f3c3a9d service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received unexpected event network-vif-plugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 for instance with vm_state active and task_state None.
Nov 30 07:14:16 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Successfully updated port: 814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquired lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG nova.compute.manager [req-ada16d2c-369a-4b67-9492-740eb47fb9c3 req-2547454c-7b44-4f3c-9ea4-5019bdb6355c service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received event network-changed-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG nova.compute.manager [req-ada16d2c-369a-4b67-9492-740eb47fb9c3 req-2547454c-7b44-4f3c-9ea4-5019bdb6355c service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Refreshing instance network info cache due to event network-changed-814f9aa9-6974-4b76-96ba-52668f19b3f1. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ada16d2c-369a-4b67-9492-740eb47fb9c3 req-2547454c-7b44-4f3c-9ea4-5019bdb6355c service nova] Acquiring lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:14:16 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:14:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-ad0440b8-d38f-47d9-ab7c-8ec1119f0330 req-8cec63bc-50cd-495f-b143-f32b70f183bd service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ad0440b8-d38f-47d9-ab7c-8ec1119f0330 req-8cec63bc-50cd-495f-b143-f32b70f183bd service nova] Acquiring lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ad0440b8-d38f-47d9-ab7c-8ec1119f0330 req-8cec63bc-50cd-495f-b143-f32b70f183bd service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ad0440b8-d38f-47d9-ab7c-8ec1119f0330 req-8cec63bc-50cd-495f-b143-f32b70f183bd service nova] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-ad0440b8-d38f-47d9-ab7c-8ec1119f0330 req-8cec63bc-50cd-495f-b143-f32b70f183bd service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] No waiting events found dispatching network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:14:17 user nova-compute[75293]: WARNING nova.compute.manager [req-ad0440b8-d38f-47d9-ab7c-8ec1119f0330 req-8cec63bc-50cd-495f-b143-f32b70f183bd service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received unexpected event network-vif-plugged-59532faa-7c54-4c8f-ac5f-bea10353a48d for instance with vm_state active and task_state deleting.
Nov 30 07:14:17 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Updating instance_info_cache with network_info: [{"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:14:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Releasing lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:14:17 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Instance network_info: |[{"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:14:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ada16d2c-369a-4b67-9492-740eb47fb9c3 req-2547454c-7b44-4f3c-9ea4-5019bdb6355c service nova] Acquired lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:14:17 user nova-compute[75293]: DEBUG nova.network.neutron [req-ada16d2c-369a-4b67-9492-740eb47fb9c3 req-2547454c-7b44-4f3c-9ea4-5019bdb6355c service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Refreshing network info cache for port 814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:14:17 user nova-compute[75293]: DEBUG nova.compute.manager [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:14:17 user nova-compute[75293]: INFO nova.compute.manager [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] instance snapshotting
Nov 30 07:14:17 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:14:17 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Took 2.00 seconds to deallocate network for instance.
Nov 30 07:14:17 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Beginning live snapshot process
Nov 30 07:14:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json -f qcow2 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:18 user nova-compute[75293]: DEBUG nova.network.neutron [req-ada16d2c-369a-4b67-9492-740eb47fb9c3 req-2547454c-7b44-4f3c-9ea4-5019bdb6355c service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Updated VIF entry in instance network info cache for port 814f9aa9-6974-4b76-96ba-52668f19b3f1. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:14:18 user nova-compute[75293]: DEBUG nova.network.neutron [req-ada16d2c-369a-4b67-9492-740eb47fb9c3 req-2547454c-7b44-4f3c-9ea4-5019bdb6355c service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Updating instance_info_cache with network_info: [{"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:14:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ada16d2c-369a-4b67-9492-740eb47fb9c3 req-2547454c-7b44-4f3c-9ea4-5019bdb6355c service nova] Releasing lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:14:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json -f qcow2" returned: 0 in 0.216s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json -f qcow2 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:18 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:14:18 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:14:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json -f qcow2" returned: 0 in 0.203s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.615s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:18 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Deleted allocations for instance 1b6dee8d-d419-47a3-b2be-4d15e17d6061
Nov 30 07:14:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.239s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp800xf0zi/869769393e904b0cabe7f901fc22ebd0.delta 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f64400c8-fa47-44d4-b580-7236fffb9410 tempest-ServerStableDeviceRescueTest-786185367 tempest-ServerStableDeviceRescueTest-786185367-project-member] Lock "1b6dee8d-d419-47a3-b2be-4d15e17d6061" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.942s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp800xf0zi/869769393e904b0cabe7f901fc22ebd0.delta 1073741824" returned: 0 in 0.069s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:18 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 07:14:18 user nova-compute[75293]: DEBUG nova.compute.manager [req-f6527274-e0b7-4c10-adda-4937d56a4fc8 req-c85c1351-3e0f-4e4a-a940-ee4501d7a44a service nova] [instance: 1b6dee8d-d419-47a3-b2be-4d15e17d6061] Received event network-vif-deleted-59532faa-7c54-4c8f-ac5f-bea10353a48d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:14:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] COPY block job progress, current cursor: 26804224 final cursor: 75497472 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:14:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:14:20 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 07:14:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:20 user nova-compute[75293]: DEBUG nova.privsep.utils [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75293) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 07:14:20 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp800xf0zi/869769393e904b0cabe7f901fc22ebd0.delta /opt/stack/data/nova/instances/snapshots/tmp800xf0zi/869769393e904b0cabe7f901fc22ebd0 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp800xf0zi/869769393e904b0cabe7f901fc22ebd0.delta /opt/stack/data/nova/instances/snapshots/tmp800xf0zi/869769393e904b0cabe7f901fc22ebd0" returned: 0 in 0.881s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:21 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Snapshot extracted, beginning image upload
Nov 30 07:14:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquiring lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquiring lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:21 user nova-compute[75293]: INFO nova.compute.manager [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Terminating instance
Nov 30 07:14:21 user nova-compute[75293]: DEBUG nova.compute.manager [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:14:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG nova.compute.manager [req-b6b7524d-1540-41ef-a407-50ac68b68a68 req-49fc83a2-d92f-44bd-b2a7-a0ac60e1852b service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Received event network-vif-unplugged-1cfef24d-7ee5-48b3-ab67-91b977aa25c3 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b6b7524d-1540-41ef-a407-50ac68b68a68 req-49fc83a2-d92f-44bd-b2a7-a0ac60e1852b service nova] Acquiring lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b6b7524d-1540-41ef-a407-50ac68b68a68 req-49fc83a2-d92f-44bd-b2a7-a0ac60e1852b service nova] Lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b6b7524d-1540-41ef-a407-50ac68b68a68 req-49fc83a2-d92f-44bd-b2a7-a0ac60e1852b service nova] Lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG nova.compute.manager [req-b6b7524d-1540-41ef-a407-50ac68b68a68 req-49fc83a2-d92f-44bd-b2a7-a0ac60e1852b service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] No waiting events found dispatching network-vif-unplugged-1cfef24d-7ee5-48b3-ab67-91b977aa25c3 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG nova.compute.manager [req-b6b7524d-1540-41ef-a407-50ac68b68a68 req-49fc83a2-d92f-44bd-b2a7-a0ac60e1852b service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Received event network-vif-unplugged-1cfef24d-7ee5-48b3-ab67-91b977aa25c3 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:14:22 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Instance destroyed successfully.
Nov 30 07:14:22 user nova-compute[75293]: DEBUG nova.objects.instance [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lazy-loading 'resources' on Instance uuid 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:12:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-44308926',display_name='tempest-VolumesActionsTest-instance-44308926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-44308926',id=17,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:12:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='379a38913c014e62b5b0256318c92dd8',ramdisk_id='',reservation_id='r-3o3600tu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2065132499',owner_user_name='tempest-VolumesActionsTest-2065132499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:12:37Z,user_data=None,user_id='09ce91e4a92b4ee9acd2c4c9929574ff',uuid=0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "address": "fa:16:3e:42:67:c2", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfef24d-7e", "ovs_interfaceid": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Converting VIF {"id": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "address": "fa:16:3e:42:67:c2", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cfef24d-7e", "ovs_interfaceid": "1cfef24d-7ee5-48b3-ab67-91b977aa25c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:67:c2,bridge_name='br-int',has_traffic_filtering=True,id=1cfef24d-7ee5-48b3-ab67-91b977aa25c3,network=Network(9d47d272-ffeb-4f6c-9246-2acefdf615a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cfef24d-7e') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG os_vif [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:67:c2,bridge_name='br-int',has_traffic_filtering=True,id=1cfef24d-7ee5-48b3-ab67-91b977aa25c3,network=Network(9d47d272-ffeb-4f6c-9246-2acefdf615a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cfef24d-7e') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1cfef24d-7e, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed06dda6-bced-458f-8a8c-4675417d7728) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:14:22 user nova-compute[75293]: INFO os_vif [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:67:c2,bridge_name='br-int',has_traffic_filtering=True,id=1cfef24d-7ee5-48b3-ab67-91b977aa25c3,network=Network(9d47d272-ffeb-4f6c-9246-2acefdf615a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cfef24d-7e')
Nov 30 07:14:22 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Deleting instance files /opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64_del
Nov 30 07:14:22 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Deletion of /opt/stack/data/nova/instances/0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64_del complete
Nov 30 07:14:22 user nova-compute[75293]: INFO nova.compute.manager [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 30 07:14:22 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:14:22 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:14:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "39042069-ac9b-4b13-b486-c845e84ac041" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "39042069-ac9b-4b13-b486-c845e84ac041" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:23 user nova-compute[75293]: DEBUG nova.compute.manager [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:14:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:14:23 user nova-compute[75293]: INFO nova.compute.claims [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Claim successful on node user
Nov 30 07:14:23 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:14:23 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:14:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:23 user nova-compute[75293]: DEBUG nova.compute.manager [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:14:23 user nova-compute[75293]: DEBUG nova.compute.manager [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:14:23 user nova-compute[75293]: DEBUG nova.network.neutron [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:14:23 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:14:23 user nova-compute[75293]: DEBUG nova.compute.manager [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG nova.policy [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e385a89f913645dd9fd2770e6e7445da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18aa2f5bea3d44ecb10ff083d6f76038', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG nova.compute.manager [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:14:24 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Creating image(s)
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "/opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "/opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "/opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-fe74e7cd-b2bc-40ce-89d5-442870b84a1a req-442302e3-ef5e-44c8-b22c-c0868f7ee05f service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Received event network-vif-deleted-1cfef24d-7ee5-48b3-ab67-91b977aa25c3 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:24 user nova-compute[75293]: INFO nova.compute.manager [req-fe74e7cd-b2bc-40ce-89d5-442870b84a1a req-442302e3-ef5e-44c8-b22c-c0868f7ee05f service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Neutron deleted interface 1cfef24d-7ee5-48b3-ab67-91b977aa25c3; detaching it from the instance and deleting it from the info cache
Nov 30 07:14:24 user nova-compute[75293]: DEBUG nova.network.neutron [req-fe74e7cd-b2bc-40ce-89d5-442870b84a1a req-442302e3-ef5e-44c8-b22c-c0868f7ee05f service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:14:24 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Took 1.30 seconds to deallocate network for instance.
Nov 30 07:14:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-fe74e7cd-b2bc-40ce-89d5-442870b84a1a req-442302e3-ef5e-44c8-b22c-c0868f7ee05f service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Detach interface failed, port_id=1cfef24d-7ee5-48b3-ab67-91b977aa25c3, reason: Instance 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64 could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.255s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-71d61c64-a7eb-4c15-85ca-b9005cfb727b req-6ed2418a-c7ee-4caf-b205-bb100acfeefe service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Received event network-vif-plugged-1cfef24d-7ee5-48b3-ab67-91b977aa25c3 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-71d61c64-a7eb-4c15-85ca-b9005cfb727b req-6ed2418a-c7ee-4caf-b205-bb100acfeefe service nova] Acquiring lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-71d61c64-a7eb-4c15-85ca-b9005cfb727b req-6ed2418a-c7ee-4caf-b205-bb100acfeefe service nova] Lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-71d61c64-a7eb-4c15-85ca-b9005cfb727b req-6ed2418a-c7ee-4caf-b205-bb100acfeefe service nova] Lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-71d61c64-a7eb-4c15-85ca-b9005cfb727b req-6ed2418a-c7ee-4caf-b205-bb100acfeefe service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] No waiting events found dispatching network-vif-plugged-1cfef24d-7ee5-48b3-ab67-91b977aa25c3 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:14:24 user nova-compute[75293]: WARNING nova.compute.manager [req-71d61c64-a7eb-4c15-85ca-b9005cfb727b req-6ed2418a-c7ee-4caf-b205-bb100acfeefe service nova] [instance: 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64] Received unexpected event network-vif-plugged-1cfef24d-7ee5-48b3-ab67-91b977aa25c3 for instance with vm_state deleted and task_state None.
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.199s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk 1073741824" returned: 0 in 0.070s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.287s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:14:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.559s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:25 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Deleted allocations for instance 0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.network.neutron [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Successfully created port: 0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "d34f99fc-343e-4e8a-83e6-372b0326bded" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "d34f99fc-343e-4e8a-83e6-372b0326bded" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.compute.manager [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Cannot resize image /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Ensure instance console log exists: /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-18ede7e8-fa32-4139-a1dc-3633761e3f9b tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "0c2fa9dd-ec0c-4288-bceb-1d4e671d5a64" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.361s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:14:25 user nova-compute[75293]: INFO nova.compute.claims [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Claim successful on node user
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:14:25 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Creating image(s)
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Did not create local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Ensure instance console log exists: /opt/stack/data/nova/instances/677602ec-88fd-4026-8112-8469855f8a78/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Start _get_guest_xml network_info=[{"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YnWrPTdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '677602ec-88fd-4026-8112-8469855f8a78', 'attached_at': '', 'detached_at': '', 'volume_id': '9f2b1463-7536-4ea8-9576-419ceeeb8314', 'serial': '9f2b1463-7536-4ea8-9576-419ceeeb8314'}, 'delete_on_termination': True, 'attachment_id': '2d35d94a-fead-4f69-85b0-bcbcc8a46f4e', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:14:25 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Snapshot image upload complete
Nov 30 07:14:25 user nova-compute[75293]: INFO nova.compute.manager [None req-03192ba8-7618-49d4-95ba-758a1621bdc2 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Took 7.84 seconds to snapshot the instance on the hypervisor.
Nov 30 07:14:25 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:14:25 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YnWrPTdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:14:25 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:14:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:14:25 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:14:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:14:25 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0026e700-c24a-48c5-a62b-ca37d6630a8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:14:25 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e859f60-fe46-4f98-9198-46049647a59c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314] added
Nov 30 07:14:25 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19fe9d4-2145-48cf-93d6-28d32b065dc9]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c79b1eb-1047-4810-b0f6-ebbcc7118090]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YnWrPTdx {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YnWrPTdx" returned: 0 in 0.036s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2527cdc6-e43e-4918-b3ab-bd2a657cce1b]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YnWrPTdx'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce8309c-a421-441b-8cd0-3680c2c4fae8]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.compute.manager [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5769dc5e-3274-4176-a30c-aa3231367938]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:14:25 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:14:25 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.network.neutron [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Successfully updated port: 0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquired lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.network.neutron [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6efd89f-69ec-4d71-a99d-b66cd8ecbceb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314, portal: 172.16.0.220,3260]
Nov 30 07:14:25 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314, portal: 172.16.0.220,3260] successful.
Nov 30 07:14:25 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.compute.manager [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:14:25 user nova-compute[75293]: DEBUG nova.network.neutron [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:14:25 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-83991269-5132-42ff-a359-e44fcbc7644f req-b5c6ae5a-9033-4282-810d-56f4b90d289a service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received event network-changed-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-83991269-5132-42ff-a359-e44fcbc7644f req-b5c6ae5a-9033-4282-810d-56f4b90d289a service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Refreshing instance network info cache due to event network-changed-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-83991269-5132-42ff-a359-e44fcbc7644f req-b5c6ae5a-9033-4282-810d-56f4b90d289a service nova] Acquiring lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.048s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d536a8-971f-4680-b257-a7c878b30fb1]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.compute.manager [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb50a370-6123-41df-94af-33acd347c7bd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:14:26 user nova-compute[75293]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:14:26 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:14:26 user nova-compute[75293]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:14:26 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.network.neutron [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.policy [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bec86b562bb54d7c9e10d8ce99723460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3973d2dcb7674ea5b11eb2007f26df78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[feea7203-a755-4b92-abcc-4b30b8c0fb63]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YnWrPTdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.compute.manager [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:14:26 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Creating image(s)
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "/opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "/opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "/opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.210s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.network.neutron [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Updating instance_info_cache with network_info: [{"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Releasing lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.compute.manager [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Instance network_info: |[{"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-83991269-5132-42ff-a359-e44fcbc7644f req-b5c6ae5a-9033-4282-810d-56f4b90d289a service nova] Acquired lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.network.neutron [req-83991269-5132-42ff-a359-e44fcbc7644f req-b5c6ae5a-9033-4282-810d-56f4b90d289a service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Refreshing network info cache for port 0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Start _get_guest_xml network_info=[{"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:14:26 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:14:26 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.195s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk 1073741824" returned: 0 in 0.061s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1239175050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1239175050',id=20,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzh49xi4NKMy4+Uk32rDD+TSdJf8Z6DRpGQmUiy7rQ8et62Zs3i28YpatQsKbwR1lGArGLXID3uOAjriRvxQM2+wm39B3BWMLufpvqn6wVgUGwByVJFVVsJ7v/OaR0ZEQ==',key_name='tempest-keypair-1386254430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18aa2f5bea3d44ecb10ff083d6f76038',ramdisk_id='',reservation_id='r-j3ig0f6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-763079906',owner_user_name='tempest-AttachVolumeShelveTestJSON-763079906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:14:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e385a89f913645dd9fd2770e6e7445da',uuid=39042069-ac9b-4b13-b486-c845e84ac041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converting VIF {"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=0b39fc27-6fcb-4dfe-b948-2d0f4f172b48,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b39fc27-6f') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.objects.instance [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'pci_devices' on Instance uuid 39042069-ac9b-4b13-b486-c845e84ac041 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:14:26 user nova-compute[75293]:   <uuid>39042069-ac9b-4b13-b486-c845e84ac041</uuid>
Nov 30 07:14:26 user nova-compute[75293]:   <name>instance-00000014</name>
Nov 30 07:14:26 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:14:26 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:14:26 user nova-compute[75293]:   <metadata>
Nov 30 07:14:26 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:14:26 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:14:26 user nova-compute[75293]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1239175050</nova:name>
Nov 30 07:14:26 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:14:26</nova:creationTime>
Nov 30 07:14:26 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:14:26 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:14:26 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:14:26 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:14:26 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:14:26 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:14:26 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:14:26 user nova-compute[75293]:       <nova:owner>
Nov 30 07:14:26 user nova-compute[75293]:         <nova:user uuid="e385a89f913645dd9fd2770e6e7445da">tempest-AttachVolumeShelveTestJSON-763079906-project-member</nova:user>
Nov 30 07:14:26 user nova-compute[75293]:         <nova:project uuid="18aa2f5bea3d44ecb10ff083d6f76038">tempest-AttachVolumeShelveTestJSON-763079906</nova:project>
Nov 30 07:14:26 user nova-compute[75293]:       </nova:owner>
Nov 30 07:14:26 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:14:26 user nova-compute[75293]:       <nova:ports>
Nov 30 07:14:26 user nova-compute[75293]:         <nova:port uuid="0b39fc27-6fcb-4dfe-b948-2d0f4f172b48">
Nov 30 07:14:26 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 07:14:26 user nova-compute[75293]:         </nova:port>
Nov 30 07:14:26 user nova-compute[75293]:       </nova:ports>
Nov 30 07:14:26 user nova-compute[75293]:     </nova:instance>
Nov 30 07:14:26 user nova-compute[75293]:   </metadata>
Nov 30 07:14:26 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:14:26 user nova-compute[75293]:     <system>
Nov 30 07:14:26 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:14:26 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:14:26 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:14:26 user nova-compute[75293]:       <entry name="serial">39042069-ac9b-4b13-b486-c845e84ac041</entry>
Nov 30 07:14:26 user nova-compute[75293]:       <entry name="uuid">39042069-ac9b-4b13-b486-c845e84ac041</entry>
Nov 30 07:14:26 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:14:26 user nova-compute[75293]:     </system>
Nov 30 07:14:26 user nova-compute[75293]:   </sysinfo>
Nov 30 07:14:26 user nova-compute[75293]:   <os>
Nov 30 07:14:26 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:14:26 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:14:26 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:14:26 user nova-compute[75293]:   </os>
Nov 30 07:14:26 user nova-compute[75293]:   <features>
Nov 30 07:14:26 user nova-compute[75293]:     <acpi/>
Nov 30 07:14:26 user nova-compute[75293]:     <apic/>
Nov 30 07:14:26 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:14:26 user nova-compute[75293]:   </features>
Nov 30 07:14:26 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:14:26 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:14:26 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:14:26 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:14:26 user nova-compute[75293]:   </clock>
Nov 30 07:14:26 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:14:26 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:14:26 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:14:26 user nova-compute[75293]:   </cpu>
Nov 30 07:14:26 user nova-compute[75293]:   <devices>
Nov 30 07:14:26 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:14:26 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:14:26 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk"/>
Nov 30 07:14:26 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:14:26 user nova-compute[75293]:     </disk>
Nov 30 07:14:26 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:14:26 user nova-compute[75293]:       <mac address="fa:16:3e:a9:6e:1e"/>
Nov 30 07:14:26 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:14:26 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:14:26 user nova-compute[75293]:       <target dev="tap0b39fc27-6f"/>
Nov 30 07:14:26 user nova-compute[75293]:     </interface>
Nov 30 07:14:26 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:14:26 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/console.log" append="off"/>
Nov 30 07:14:26 user nova-compute[75293]:     </serial>
Nov 30 07:14:26 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:14:26 user nova-compute[75293]:     <video>
Nov 30 07:14:26 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:14:26 user nova-compute[75293]:     </video>
Nov 30 07:14:26 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:14:26 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:14:26 user nova-compute[75293]:     </rng>
Nov 30 07:14:26 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:14:26 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:14:26 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:14:26 user nova-compute[75293]:     </memballoon>
Nov 30 07:14:26 user nova-compute[75293]:   </devices>
Nov 30 07:14:26 user nova-compute[75293]: </domain>
Nov 30 07:14:26 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1239175050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1239175050',id=20,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzh49xi4NKMy4+Uk32rDD+TSdJf8Z6DRpGQmUiy7rQ8et62Zs3i28YpatQsKbwR1lGArGLXID3uOAjriRvxQM2+wm39B3BWMLufpvqn6wVgUGwByVJFVVsJ7v/OaR0ZEQ==',key_name='tempest-keypair-1386254430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18aa2f5bea3d44ecb10ff083d6f76038',ramdisk_id='',reservation_id='r-j3ig0f6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-763079906',owner_user_name='tempest-AttachVolumeShelveTestJSON-763079906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:14:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e385a89f913645dd9fd2770e6e7445da',uuid=39042069-ac9b-4b13-b486-c845e84ac041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converting VIF {"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=0b39fc27-6fcb-4dfe-b948-2d0f4f172b48,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b39fc27-6f') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG os_vif [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=0b39fc27-6fcb-4dfe-b948-2d0f4f172b48,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b39fc27-6f') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a8a109c4-202a-58e1-9a7a-1263dc55c835', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b39fc27-6f, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b39fc27-6f, col_values=(('qos', UUID('1fdab90b-b8d8-4f17-a335-9e2694288323')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b39fc27-6f, col_values=(('external_ids', {'iface-id': '0b39fc27-6fcb-4dfe-b948-2d0f4f172b48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:6e:1e', 'vm-uuid': '39042069-ac9b-4b13-b486-c845e84ac041'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:26 user nova-compute[75293]: INFO os_vif [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=0b39fc27-6fcb-4dfe-b948-2d0f4f172b48,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b39fc27-6f')
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.205s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.network.neutron [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Successfully created port: b47caadd-df9c-46df-99fe-24210b7a4f1c {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:14:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] No VIF found with MAC fa:16:3e:a9:6e:1e, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Cannot resize image /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Ensure instance console log exists: /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] <== connect_volume: return (1479ms) {'type': 'block', 'scsi_wwn': '23132346530656130', 'path': '/dev/sdb'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132346530656130', 'path': '/dev/sdb'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:14:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-770610968',display_name='tempest-TestShelveInstance-server-770610968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-770610968',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLM1q2xWwt8nZI6FCB7oMRauNhjDcCuEsDd6hTQ69yj0BH9+/FJi552VJ2tgJb+JE66cg7iUXvN2C/cnao+LM3IbIqZxCcYZKEkU6EmLjbe4gKvpfOHWja2udvl5EpNvCw==',key_name='tempest-TestShelveInstance-816209512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb68dc3daea04910bc7f11d6acdd91a6',ramdisk_id='',reservation_id='r-u75fgbpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-620093432',owner_user_name='tempest-TestShelveInstance-620093432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:14:15Z,user_data=None,user_id='1470bbdb1f494cca880294d2e97d3a01',uuid=677602ec-88fd-4026-8112-8469855f8a78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Converting VIF {"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=814f9aa9-6974-4b76-96ba-52668f19b3f1,network=Network(c9521d26-96fd-4c02-88a6-c6cc9d945905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f9aa9-69') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG nova.objects.instance [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lazy-loading 'pci_devices' on Instance uuid 677602ec-88fd-4026-8112-8469855f8a78 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:14:27 user nova-compute[75293]:   <uuid>677602ec-88fd-4026-8112-8469855f8a78</uuid>
Nov 30 07:14:27 user nova-compute[75293]:   <name>instance-00000013</name>
Nov 30 07:14:27 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:14:27 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:14:27 user nova-compute[75293]:   <metadata>
Nov 30 07:14:27 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:14:27 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:14:27 user nova-compute[75293]:       <nova:name>tempest-TestShelveInstance-server-770610968</nova:name>
Nov 30 07:14:27 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:14:25</nova:creationTime>
Nov 30 07:14:27 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:14:27 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:14:27 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:14:27 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:14:27 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:14:27 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:14:27 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:14:27 user nova-compute[75293]:       <nova:owner>
Nov 30 07:14:27 user nova-compute[75293]:         <nova:user uuid="1470bbdb1f494cca880294d2e97d3a01">tempest-TestShelveInstance-620093432-project-member</nova:user>
Nov 30 07:14:27 user nova-compute[75293]:         <nova:project uuid="bb68dc3daea04910bc7f11d6acdd91a6">tempest-TestShelveInstance-620093432</nova:project>
Nov 30 07:14:27 user nova-compute[75293]:       </nova:owner>
Nov 30 07:14:27 user nova-compute[75293]:       <nova:ports>
Nov 30 07:14:27 user nova-compute[75293]:         <nova:port uuid="814f9aa9-6974-4b76-96ba-52668f19b3f1">
Nov 30 07:14:27 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 07:14:27 user nova-compute[75293]:         </nova:port>
Nov 30 07:14:27 user nova-compute[75293]:       </nova:ports>
Nov 30 07:14:27 user nova-compute[75293]:     </nova:instance>
Nov 30 07:14:27 user nova-compute[75293]:   </metadata>
Nov 30 07:14:27 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:14:27 user nova-compute[75293]:     <system>
Nov 30 07:14:27 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:14:27 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:14:27 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:14:27 user nova-compute[75293]:       <entry name="serial">677602ec-88fd-4026-8112-8469855f8a78</entry>
Nov 30 07:14:27 user nova-compute[75293]:       <entry name="uuid">677602ec-88fd-4026-8112-8469855f8a78</entry>
Nov 30 07:14:27 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:14:27 user nova-compute[75293]:     </system>
Nov 30 07:14:27 user nova-compute[75293]:   </sysinfo>
Nov 30 07:14:27 user nova-compute[75293]:   <os>
Nov 30 07:14:27 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:14:27 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:14:27 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:14:27 user nova-compute[75293]:   </os>
Nov 30 07:14:27 user nova-compute[75293]:   <features>
Nov 30 07:14:27 user nova-compute[75293]:     <acpi/>
Nov 30 07:14:27 user nova-compute[75293]:     <apic/>
Nov 30 07:14:27 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:14:27 user nova-compute[75293]:   </features>
Nov 30 07:14:27 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:14:27 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:14:27 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:14:27 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:14:27 user nova-compute[75293]:   </clock>
Nov 30 07:14:27 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:14:27 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:14:27 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:14:27 user nova-compute[75293]:   </cpu>
Nov 30 07:14:27 user nova-compute[75293]:   <devices>
Nov 30 07:14:27 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:14:27 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:14:27 user nova-compute[75293]:       <source dev="/dev/sdb"/>
Nov 30 07:14:27 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:14:27 user nova-compute[75293]:       <serial>9f2b1463-7536-4ea8-9576-419ceeeb8314</serial>
Nov 30 07:14:27 user nova-compute[75293]:     </disk>
Nov 30 07:14:27 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:14:27 user nova-compute[75293]:       <mac address="fa:16:3e:60:bb:6e"/>
Nov 30 07:14:27 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:14:27 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:14:27 user nova-compute[75293]:       <target dev="tap814f9aa9-69"/>
Nov 30 07:14:27 user nova-compute[75293]:     </interface>
Nov 30 07:14:27 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:14:27 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/677602ec-88fd-4026-8112-8469855f8a78/console.log" append="off"/>
Nov 30 07:14:27 user nova-compute[75293]:     </serial>
Nov 30 07:14:27 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:14:27 user nova-compute[75293]:     <video>
Nov 30 07:14:27 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:14:27 user nova-compute[75293]:     </video>
Nov 30 07:14:27 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:14:27 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:14:27 user nova-compute[75293]:     </rng>
Nov 30 07:14:27 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:14:27 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:14:27 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:14:27 user nova-compute[75293]:     </memballoon>
Nov 30 07:14:27 user nova-compute[75293]:   </devices>
Nov 30 07:14:27 user nova-compute[75293]: </domain>
Nov 30 07:14:27 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:14:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-770610968',display_name='tempest-TestShelveInstance-server-770610968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-770610968',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLM1q2xWwt8nZI6FCB7oMRauNhjDcCuEsDd6hTQ69yj0BH9+/FJi552VJ2tgJb+JE66cg7iUXvN2C/cnao+LM3IbIqZxCcYZKEkU6EmLjbe4gKvpfOHWja2udvl5EpNvCw==',key_name='tempest-TestShelveInstance-816209512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb68dc3daea04910bc7f11d6acdd91a6',ramdisk_id='',reservation_id='r-u75fgbpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-620093432',owner_user_name='tempest-TestShelveInstance-620093432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:14:15Z,user_data=None,user_id='1470bbdb1f494cca880294d2e97d3a01',uuid=677602ec-88fd-4026-8112-8469855f8a78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Converting VIF {"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=814f9aa9-6974-4b76-96ba-52668f19b3f1,network=Network(c9521d26-96fd-4c02-88a6-c6cc9d945905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f9aa9-69') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG os_vif [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=814f9aa9-6974-4b76-96ba-52668f19b3f1,network=Network(c9521d26-96fd-4c02-88a6-c6cc9d945905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f9aa9-69') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d7a99c1-efd7-599c-8cb3-8746cf557f64', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG nova.network.neutron [req-83991269-5132-42ff-a359-e44fcbc7644f req-b5c6ae5a-9033-4282-810d-56f4b90d289a service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Updated VIF entry in instance network info cache for port 0b39fc27-6fcb-4dfe-b948-2d0f4f172b48. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG nova.network.neutron [req-83991269-5132-42ff-a359-e44fcbc7644f req-b5c6ae5a-9033-4282-810d-56f4b90d289a service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Updating instance_info_cache with network_info: [{"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap814f9aa9-69, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap814f9aa9-69, col_values=(('qos', UUID('5a9cea64-f136-4a8c-b5e6-006105840744')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap814f9aa9-69, col_values=(('external_ids', {'iface-id': '814f9aa9-6974-4b76-96ba-52668f19b3f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:bb:6e', 'vm-uuid': '677602ec-88fd-4026-8112-8469855f8a78'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-83991269-5132-42ff-a359-e44fcbc7644f req-b5c6ae5a-9033-4282-810d-56f4b90d289a service nova] Releasing lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:27 user nova-compute[75293]: INFO os_vif [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=814f9aa9-6974-4b76-96ba-52668f19b3f1,network=Network(c9521d26-96fd-4c02-88a6-c6cc9d945905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f9aa9-69')
Nov 30 07:14:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] No VIF found with MAC fa:16:3e:60:bb:6e, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG nova.network.neutron [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Successfully updated port: b47caadd-df9c-46df-99fe-24210b7a4f1c {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "refresh_cache-d34f99fc-343e-4e8a-83e6-372b0326bded" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquired lock "refresh_cache-d34f99fc-343e-4e8a-83e6-372b0326bded" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG nova.network.neutron [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:14:27 user nova-compute[75293]: DEBUG nova.network.neutron [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.compute.manager [req-bf532bcd-c49c-476f-9a0c-8420a49d0515 req-46e7588a-7c5c-4f0c-beb6-8f72540f27eb service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Received event network-changed-b47caadd-df9c-46df-99fe-24210b7a4f1c {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.compute.manager [req-bf532bcd-c49c-476f-9a0c-8420a49d0515 req-46e7588a-7c5c-4f0c-beb6-8f72540f27eb service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Refreshing instance network info cache due to event network-changed-b47caadd-df9c-46df-99fe-24210b7a4f1c. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-bf532bcd-c49c-476f-9a0c-8420a49d0515 req-46e7588a-7c5c-4f0c-beb6-8f72540f27eb service nova] Acquiring lock "refresh_cache-d34f99fc-343e-4e8a-83e6-372b0326bded" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.network.neutron [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Updating instance_info_cache with network_info: [{"id": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "address": "fa:16:3e:d8:cd:81", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47caadd-df", "ovs_interfaceid": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Releasing lock "refresh_cache-d34f99fc-343e-4e8a-83e6-372b0326bded" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.compute.manager [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Instance network_info: |[{"id": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "address": "fa:16:3e:d8:cd:81", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47caadd-df", "ovs_interfaceid": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-bf532bcd-c49c-476f-9a0c-8420a49d0515 req-46e7588a-7c5c-4f0c-beb6-8f72540f27eb service nova] Acquired lock "refresh_cache-d34f99fc-343e-4e8a-83e6-372b0326bded" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.network.neutron [req-bf532bcd-c49c-476f-9a0c-8420a49d0515 req-46e7588a-7c5c-4f0c-beb6-8f72540f27eb service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Refreshing network info cache for port b47caadd-df9c-46df-99fe-24210b7a4f1c {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Start _get_guest_xml network_info=[{"id": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "address": "fa:16:3e:d8:cd:81", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47caadd-df", "ovs_interfaceid": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:14:28 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:14:28 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-431831329',display_name='tempest-TestStampPattern-server-431831329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-431831329',id=21,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0qMxl7UVzzNRBhKaK7jCT6r/53GRkB3Di+2AcuMeqPobnGiie2ivpr0tiN4y2/+N5eqEzUQwswDBS+N1ym58HFieIzNbbIOVxlbtYOwXvyj9jGINm6Alzpe31PR/dT3g==',key_name='tempest-TestStampPattern-1639076054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3973d2dcb7674ea5b11eb2007f26df78',ramdisk_id='',reservation_id='r-guisa0ah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1058543327',owner_user_name='tempest-TestStampPattern-1058543327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:14:26Z,user_data=None,user_id='bec86b562bb54d7c9e10d8ce99723460',uuid=d34f99fc-343e-4e8a-83e6-372b0326bded,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "address": "fa:16:3e:d8:cd:81", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47caadd-df", "ovs_interfaceid": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Converting VIF {"id": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "address": "fa:16:3e:d8:cd:81", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47caadd-df", "ovs_interfaceid": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=b47caadd-df9c-46df-99fe-24210b7a4f1c,network=Network(bab4085c-ab04-4e03-912e-6c6c8fde90b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47caadd-df') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.objects.instance [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lazy-loading 'pci_devices' on Instance uuid d34f99fc-343e-4e8a-83e6-372b0326bded {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:14:28 user nova-compute[75293]:   <uuid>d34f99fc-343e-4e8a-83e6-372b0326bded</uuid>
Nov 30 07:14:28 user nova-compute[75293]:   <name>instance-00000015</name>
Nov 30 07:14:28 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:14:28 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:14:28 user nova-compute[75293]:   <metadata>
Nov 30 07:14:28 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:14:28 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:14:28 user nova-compute[75293]:       <nova:name>tempest-TestStampPattern-server-431831329</nova:name>
Nov 30 07:14:28 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:14:28</nova:creationTime>
Nov 30 07:14:28 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:14:28 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:14:28 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:14:28 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:14:28 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:14:28 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:14:28 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:14:28 user nova-compute[75293]:       <nova:owner>
Nov 30 07:14:28 user nova-compute[75293]:         <nova:user uuid="bec86b562bb54d7c9e10d8ce99723460">tempest-TestStampPattern-1058543327-project-member</nova:user>
Nov 30 07:14:28 user nova-compute[75293]:         <nova:project uuid="3973d2dcb7674ea5b11eb2007f26df78">tempest-TestStampPattern-1058543327</nova:project>
Nov 30 07:14:28 user nova-compute[75293]:       </nova:owner>
Nov 30 07:14:28 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:14:28 user nova-compute[75293]:       <nova:ports>
Nov 30 07:14:28 user nova-compute[75293]:         <nova:port uuid="b47caadd-df9c-46df-99fe-24210b7a4f1c">
Nov 30 07:14:28 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 30 07:14:28 user nova-compute[75293]:         </nova:port>
Nov 30 07:14:28 user nova-compute[75293]:       </nova:ports>
Nov 30 07:14:28 user nova-compute[75293]:     </nova:instance>
Nov 30 07:14:28 user nova-compute[75293]:   </metadata>
Nov 30 07:14:28 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:14:28 user nova-compute[75293]:     <system>
Nov 30 07:14:28 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:14:28 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:14:28 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:14:28 user nova-compute[75293]:       <entry name="serial">d34f99fc-343e-4e8a-83e6-372b0326bded</entry>
Nov 30 07:14:28 user nova-compute[75293]:       <entry name="uuid">d34f99fc-343e-4e8a-83e6-372b0326bded</entry>
Nov 30 07:14:28 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:14:28 user nova-compute[75293]:     </system>
Nov 30 07:14:28 user nova-compute[75293]:   </sysinfo>
Nov 30 07:14:28 user nova-compute[75293]:   <os>
Nov 30 07:14:28 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:14:28 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:14:28 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:14:28 user nova-compute[75293]:   </os>
Nov 30 07:14:28 user nova-compute[75293]:   <features>
Nov 30 07:14:28 user nova-compute[75293]:     <acpi/>
Nov 30 07:14:28 user nova-compute[75293]:     <apic/>
Nov 30 07:14:28 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:14:28 user nova-compute[75293]:   </features>
Nov 30 07:14:28 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:14:28 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:14:28 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:14:28 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:14:28 user nova-compute[75293]:   </clock>
Nov 30 07:14:28 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:14:28 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:14:28 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:14:28 user nova-compute[75293]:   </cpu>
Nov 30 07:14:28 user nova-compute[75293]:   <devices>
Nov 30 07:14:28 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:14:28 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:14:28 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk"/>
Nov 30 07:14:28 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:14:28 user nova-compute[75293]:     </disk>
Nov 30 07:14:28 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:14:28 user nova-compute[75293]:       <mac address="fa:16:3e:d8:cd:81"/>
Nov 30 07:14:28 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:14:28 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:14:28 user nova-compute[75293]:       <target dev="tapb47caadd-df"/>
Nov 30 07:14:28 user nova-compute[75293]:     </interface>
Nov 30 07:14:28 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:14:28 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/console.log" append="off"/>
Nov 30 07:14:28 user nova-compute[75293]:     </serial>
Nov 30 07:14:28 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:14:28 user nova-compute[75293]:     <video>
Nov 30 07:14:28 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:14:28 user nova-compute[75293]:     </video>
Nov 30 07:14:28 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:14:28 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:14:28 user nova-compute[75293]:     </rng>
Nov 30 07:14:28 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:14:28 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:14:28 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:14:28 user nova-compute[75293]:     </memballoon>
Nov 30 07:14:28 user nova-compute[75293]:   </devices>
Nov 30 07:14:28 user nova-compute[75293]: </domain>
Nov 30 07:14:28 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-431831329',display_name='tempest-TestStampPattern-server-431831329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-431831329',id=21,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0qMxl7UVzzNRBhKaK7jCT6r/53GRkB3Di+2AcuMeqPobnGiie2ivpr0tiN4y2/+N5eqEzUQwswDBS+N1ym58HFieIzNbbIOVxlbtYOwXvyj9jGINm6Alzpe31PR/dT3g==',key_name='tempest-TestStampPattern-1639076054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3973d2dcb7674ea5b11eb2007f26df78',ramdisk_id='',reservation_id='r-guisa0ah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1058543327',owner_user_name='tempest-TestStampPattern-1058543327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:14:26Z,user_data=None,user_id='bec86b562bb54d7c9e10d8ce99723460',uuid=d34f99fc-343e-4e8a-83e6-372b0326bded,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "address": "fa:16:3e:d8:cd:81", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47caadd-df", "ovs_interfaceid": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Converting VIF {"id": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "address": "fa:16:3e:d8:cd:81", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47caadd-df", "ovs_interfaceid": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=b47caadd-df9c-46df-99fe-24210b7a4f1c,network=Network(bab4085c-ab04-4e03-912e-6c6c8fde90b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47caadd-df') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG os_vif [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=b47caadd-df9c-46df-99fe-24210b7a4f1c,network=Network(bab4085c-ab04-4e03-912e-6c6c8fde90b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47caadd-df') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c9ee18b-ec36-5bfd-a465-ded1878a6331', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb47caadd-df, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb47caadd-df, col_values=(('qos', UUID('d86b1ae5-a28d-4f4f-a77f-94aa25ec942e')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb47caadd-df, col_values=(('external_ids', {'iface-id': 'b47caadd-df9c-46df-99fe-24210b7a4f1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:cd:81', 'vm-uuid': 'd34f99fc-343e-4e8a-83e6-372b0326bded'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:28 user nova-compute[75293]: INFO os_vif [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=b47caadd-df9c-46df-99fe-24210b7a4f1c,network=Network(bab4085c-ab04-4e03-912e-6c6c8fde90b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47caadd-df')
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] No VIF found with MAC fa:16:3e:d8:cd:81, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.network.neutron [req-bf532bcd-c49c-476f-9a0c-8420a49d0515 req-46e7588a-7c5c-4f0c-beb6-8f72540f27eb service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Updated VIF entry in instance network info cache for port b47caadd-df9c-46df-99fe-24210b7a4f1c. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG nova.network.neutron [req-bf532bcd-c49c-476f-9a0c-8420a49d0515 req-46e7588a-7c5c-4f0c-beb6-8f72540f27eb service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Updating instance_info_cache with network_info: [{"id": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "address": "fa:16:3e:d8:cd:81", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47caadd-df", "ovs_interfaceid": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:14:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-bf532bcd-c49c-476f-9a0c-8420a49d0515 req-46e7588a-7c5c-4f0c-beb6-8f72540f27eb service nova] Releasing lock "refresh_cache-d34f99fc-343e-4e8a-83e6-372b0326bded" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:14:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-05e4d700-7fbc-4f1d-b40e-508594efa106 req-b8c04b69-c997-40e9-b1b1-8d3977652b4d service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received event network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-05e4d700-7fbc-4f1d-b40e-508594efa106 req-b8c04b69-c997-40e9-b1b1-8d3977652b4d service nova] Acquiring lock "39042069-ac9b-4b13-b486-c845e84ac041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-05e4d700-7fbc-4f1d-b40e-508594efa106 req-b8c04b69-c997-40e9-b1b1-8d3977652b4d service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-05e4d700-7fbc-4f1d-b40e-508594efa106 req-b8c04b69-c997-40e9-b1b1-8d3977652b4d service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-05e4d700-7fbc-4f1d-b40e-508594efa106 req-b8c04b69-c997-40e9-b1b1-8d3977652b4d service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] No waiting events found dispatching network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:14:30 user nova-compute[75293]: WARNING nova.compute.manager [req-05e4d700-7fbc-4f1d-b40e-508594efa106 req-b8c04b69-c997-40e9-b1b1-8d3977652b4d service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received unexpected event network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 for instance with vm_state building and task_state spawning.
Nov 30 07:14:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-7a0d2312-82c7-4f33-874a-15573d1f2684 req-2ec6d690-9cd7-4062-8837-8c6bc675b0bc service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received event network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7a0d2312-82c7-4f33-874a-15573d1f2684 req-2ec6d690-9cd7-4062-8837-8c6bc675b0bc service nova] Acquiring lock "39042069-ac9b-4b13-b486-c845e84ac041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7a0d2312-82c7-4f33-874a-15573d1f2684 req-2ec6d690-9cd7-4062-8837-8c6bc675b0bc service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7a0d2312-82c7-4f33-874a-15573d1f2684 req-2ec6d690-9cd7-4062-8837-8c6bc675b0bc service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-7a0d2312-82c7-4f33-874a-15573d1f2684 req-2ec6d690-9cd7-4062-8837-8c6bc675b0bc service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] No waiting events found dispatching network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:14:32 user nova-compute[75293]: WARNING nova.compute.manager [req-7a0d2312-82c7-4f33-874a-15573d1f2684 req-2ec6d690-9cd7-4062-8837-8c6bc675b0bc service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received unexpected event network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 for instance with vm_state building and task_state spawning.
Nov 30 07:14:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-7a0d2312-82c7-4f33-874a-15573d1f2684 req-2ec6d690-9cd7-4062-8837-8c6bc675b0bc service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Received event network-vif-plugged-b47caadd-df9c-46df-99fe-24210b7a4f1c {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7a0d2312-82c7-4f33-874a-15573d1f2684 req-2ec6d690-9cd7-4062-8837-8c6bc675b0bc service nova] Acquiring lock "d34f99fc-343e-4e8a-83e6-372b0326bded-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7a0d2312-82c7-4f33-874a-15573d1f2684 req-2ec6d690-9cd7-4062-8837-8c6bc675b0bc service nova] Lock "d34f99fc-343e-4e8a-83e6-372b0326bded-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7a0d2312-82c7-4f33-874a-15573d1f2684 req-2ec6d690-9cd7-4062-8837-8c6bc675b0bc service nova] Lock "d34f99fc-343e-4e8a-83e6-372b0326bded-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-7a0d2312-82c7-4f33-874a-15573d1f2684 req-2ec6d690-9cd7-4062-8837-8c6bc675b0bc service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] No waiting events found dispatching network-vif-plugged-b47caadd-df9c-46df-99fe-24210b7a4f1c {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:14:32 user nova-compute[75293]: WARNING nova.compute.manager [req-7a0d2312-82c7-4f33-874a-15573d1f2684 req-2ec6d690-9cd7-4062-8837-8c6bc675b0bc service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Received unexpected event network-vif-plugged-b47caadd-df9c-46df-99fe-24210b7a4f1c for instance with vm_state building and task_state spawning.
Nov 30 07:14:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-7a0d2312-82c7-4f33-874a-15573d1f2684 req-2ec6d690-9cd7-4062-8837-8c6bc675b0bc service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Received event network-vif-plugged-b47caadd-df9c-46df-99fe-24210b7a4f1c {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7a0d2312-82c7-4f33-874a-15573d1f2684 req-2ec6d690-9cd7-4062-8837-8c6bc675b0bc service nova] Acquiring lock "d34f99fc-343e-4e8a-83e6-372b0326bded-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7a0d2312-82c7-4f33-874a-15573d1f2684 req-2ec6d690-9cd7-4062-8837-8c6bc675b0bc service nova] Lock "d34f99fc-343e-4e8a-83e6-372b0326bded-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7a0d2312-82c7-4f33-874a-15573d1f2684 req-2ec6d690-9cd7-4062-8837-8c6bc675b0bc service nova] Lock "d34f99fc-343e-4e8a-83e6-372b0326bded-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-7a0d2312-82c7-4f33-874a-15573d1f2684 req-2ec6d690-9cd7-4062-8837-8c6bc675b0bc service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] No waiting events found dispatching network-vif-plugged-b47caadd-df9c-46df-99fe-24210b7a4f1c {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:14:32 user nova-compute[75293]: WARNING nova.compute.manager [req-7a0d2312-82c7-4f33-874a-15573d1f2684 req-2ec6d690-9cd7-4062-8837-8c6bc675b0bc service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Received unexpected event network-vif-plugged-b47caadd-df9c-46df-99fe-24210b7a4f1c for instance with vm_state building and task_state spawning.
Nov 30 07:14:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:33 user nova-compute[75293]: DEBUG nova.compute.manager [req-83ea5737-f173-41c9-a7e8-2fed02195ebe req-9e6e9153-1f50-40f1-bf70-8d2f593b9564 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received event network-vif-plugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-83ea5737-f173-41c9-a7e8-2fed02195ebe req-9e6e9153-1f50-40f1-bf70-8d2f593b9564 service nova] Acquiring lock "677602ec-88fd-4026-8112-8469855f8a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-83ea5737-f173-41c9-a7e8-2fed02195ebe req-9e6e9153-1f50-40f1-bf70-8d2f593b9564 service nova] Lock "677602ec-88fd-4026-8112-8469855f8a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-83ea5737-f173-41c9-a7e8-2fed02195ebe req-9e6e9153-1f50-40f1-bf70-8d2f593b9564 service nova] Lock "677602ec-88fd-4026-8112-8469855f8a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:33 user nova-compute[75293]: DEBUG nova.compute.manager [req-83ea5737-f173-41c9-a7e8-2fed02195ebe req-9e6e9153-1f50-40f1-bf70-8d2f593b9564 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] No waiting events found dispatching network-vif-plugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:14:33 user nova-compute[75293]: WARNING nova.compute.manager [req-83ea5737-f173-41c9-a7e8-2fed02195ebe req-9e6e9153-1f50-40f1-bf70-8d2f593b9564 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received unexpected event network-vif-plugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 for instance with vm_state building and task_state spawning.
Nov 30 07:14:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.compute.manager [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:14:34 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Instance spawned successfully.
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:34 user nova-compute[75293]: INFO nova.compute.manager [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Took 10.05 seconds to spawn the instance on the hypervisor.
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.compute.manager [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:14:34 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Instance spawned successfully.
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:14:34 user nova-compute[75293]: INFO nova.compute.manager [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Took 10.93 seconds to build instance.
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.compute.manager [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-55c6782d-35c3-4887-b672-c535890c4fe1 tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "39042069-ac9b-4b13-b486-c845e84ac041" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.065s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:34 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Instance spawned successfully.
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:14:34 user nova-compute[75293]: INFO nova.compute.manager [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Took 8.82 seconds to spawn the instance on the hypervisor.
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:14:34 user nova-compute[75293]: INFO nova.compute.manager [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Took 8.22 seconds to spawn the instance on the hypervisor.
Nov 30 07:14:34 user nova-compute[75293]: DEBUG nova.compute.manager [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:14:34 user nova-compute[75293]: INFO nova.compute.manager [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Took 19.86 seconds to build instance.
Nov 30 07:14:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ca747345-5e07-417a-af34-e3e5383b9a5e tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "677602ec-88fd-4026-8112-8469855f8a78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.994s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:34 user nova-compute[75293]: INFO nova.compute.manager [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Took 9.27 seconds to build instance.
Nov 30 07:14:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-4ad3d5de-8485-40e1-9d1a-0d4a89607bc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "d34f99fc-343e-4e8a-83e6-372b0326bded" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.377s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:35 user nova-compute[75293]: DEBUG nova.compute.manager [req-ba698021-66a7-40d8-a57d-b198f30e9336 req-bbd538e3-081a-4e68-a782-6bf90dd20f35 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received event network-vif-plugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ba698021-66a7-40d8-a57d-b198f30e9336 req-bbd538e3-081a-4e68-a782-6bf90dd20f35 service nova] Acquiring lock "677602ec-88fd-4026-8112-8469855f8a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ba698021-66a7-40d8-a57d-b198f30e9336 req-bbd538e3-081a-4e68-a782-6bf90dd20f35 service nova] Lock "677602ec-88fd-4026-8112-8469855f8a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ba698021-66a7-40d8-a57d-b198f30e9336 req-bbd538e3-081a-4e68-a782-6bf90dd20f35 service nova] Lock "677602ec-88fd-4026-8112-8469855f8a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:35 user nova-compute[75293]: DEBUG nova.compute.manager [req-ba698021-66a7-40d8-a57d-b198f30e9336 req-bbd538e3-081a-4e68-a782-6bf90dd20f35 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] No waiting events found dispatching network-vif-plugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:14:35 user nova-compute[75293]: WARNING nova.compute.manager [req-ba698021-66a7-40d8-a57d-b198f30e9336 req-bbd538e3-081a-4e68-a782-6bf90dd20f35 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received unexpected event network-vif-plugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 for instance with vm_state active and task_state None.
Nov 30 07:14:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Acquiring lock "093deaa6-a68c-4688-9055-69dda63b6b4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:44 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:14:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:44 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:14:44 user nova-compute[75293]: INFO nova.compute.claims [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Claim successful on node user
Nov 30 07:14:44 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:14:44 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:14:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:44 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:14:44 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:14:44 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:14:44 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:14:44 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:14:44 user nova-compute[75293]: INFO nova.virt.block_device [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Booting with volume 92ccb270-8b75-445c-b80f-4af3ec1018db at /dev/vda
Nov 30 07:14:44 user nova-compute[75293]: DEBUG nova.policy [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9359a918c1394350baf3814eac14c8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b1b51e818e442ab5d4b68fede61c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG os_brick.utils [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a14373-ee31-4fc1-83f6-b8853b6a3dfd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8455261-fd27-4075-9cdc-3ef41fbe3c8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7b1189-0bdb-4db7-93fa-b726fe48610e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9fce49-769d-4225-a5b6-e516f8e8a605]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:14:45 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:14:45 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[907ce2df-ac6e-484d-8397-a568cb251c65]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG os_brick.utils [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Updating existing volume attachment record: 8044835c-60b7-4327-a1ec-818b16486fff {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:14:45 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Successfully created port: 23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:14:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:46 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Successfully updated port: 23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:14:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Acquiring lock "refresh_cache-093deaa6-a68c-4688-9055-69dda63b6b4c" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:14:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Acquired lock "refresh_cache-093deaa6-a68c-4688-9055-69dda63b6b4c" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:14:46 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:14:46 user nova-compute[75293]: DEBUG nova.compute.manager [req-ea26b72b-ace4-4185-97ef-c65877180b9c req-2be0ac3a-d2cf-4c8e-8fbd-86e63ac0b3d6 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received event network-changed-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:46 user nova-compute[75293]: DEBUG nova.compute.manager [req-ea26b72b-ace4-4185-97ef-c65877180b9c req-2be0ac3a-d2cf-4c8e-8fbd-86e63ac0b3d6 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Refreshing instance network info cache due to event network-changed-23b984e7-f18d-4c93-9720-0184ff3d6e0a. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:14:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ea26b72b-ace4-4185-97ef-c65877180b9c req-2be0ac3a-d2cf-4c8e-8fbd-86e63ac0b3d6 service nova] Acquiring lock "refresh_cache-093deaa6-a68c-4688-9055-69dda63b6b4c" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:14:46 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:14:46 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Updating instance_info_cache with network_info: [{"id": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "address": "fa:16:3e:e7:42:bf", "network": {"id": "1c0cc61f-f779-4846-a964-db0ac1ed358a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1209595465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b1b51e818e442ab5d4b68fede61c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b984e7-f1", "ovs_interfaceid": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:14:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Releasing lock "refresh_cache-093deaa6-a68c-4688-9055-69dda63b6b4c" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:14:46 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Instance network_info: |[{"id": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "address": "fa:16:3e:e7:42:bf", "network": {"id": "1c0cc61f-f779-4846-a964-db0ac1ed358a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1209595465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b1b51e818e442ab5d4b68fede61c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b984e7-f1", "ovs_interfaceid": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:14:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ea26b72b-ace4-4185-97ef-c65877180b9c req-2be0ac3a-d2cf-4c8e-8fbd-86e63ac0b3d6 service nova] Acquired lock "refresh_cache-093deaa6-a68c-4688-9055-69dda63b6b4c" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:14:46 user nova-compute[75293]: DEBUG nova.network.neutron [req-ea26b72b-ace4-4185-97ef-c65877180b9c req-2be0ac3a-d2cf-4c8e-8fbd-86e63ac0b3d6 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Refreshing network info cache for port 23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:14:47 user nova-compute[75293]: DEBUG nova.network.neutron [req-ea26b72b-ace4-4185-97ef-c65877180b9c req-2be0ac3a-d2cf-4c8e-8fbd-86e63ac0b3d6 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Updated VIF entry in instance network info cache for port 23b984e7-f18d-4c93-9720-0184ff3d6e0a. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:14:47 user nova-compute[75293]: DEBUG nova.network.neutron [req-ea26b72b-ace4-4185-97ef-c65877180b9c req-2be0ac3a-d2cf-4c8e-8fbd-86e63ac0b3d6 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Updating instance_info_cache with network_info: [{"id": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "address": "fa:16:3e:e7:42:bf", "network": {"id": "1c0cc61f-f779-4846-a964-db0ac1ed358a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1209595465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b1b51e818e442ab5d4b68fede61c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b984e7-f1", "ovs_interfaceid": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:14:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ea26b72b-ace4-4185-97ef-c65877180b9c req-2be0ac3a-d2cf-4c8e-8fbd-86e63ac0b3d6 service nova] Releasing lock "refresh_cache-093deaa6-a68c-4688-9055-69dda63b6b4c" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:14:47 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:14:47 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:14:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:48 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:14:50 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:14:50 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:14:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:51 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:14:51 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:14:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-009f70bc-7561-48fe-ba47-ebaf4d81d462" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:14:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-009f70bc-7561-48fe-ba47-ebaf4d81d462" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:14:51 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:14:52 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Updating instance_info_cache with network_info: [{"id": "3d550d68-3322-4126-8dce-9201214e61f8", "address": "fa:16:3e:79:15:d4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d550d68-33", "ovs_interfaceid": "3d550d68-3322-4126-8dce-9201214e61f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:14:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-009f70bc-7561-48fe-ba47-ebaf4d81d462" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:14:52 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:14:52 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:14:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:52 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:14:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:14:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:14:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:14:54 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Creating image(s)
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Did not create local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Ensure instance console log exists: /opt/stack/data/nova/instances/093deaa6-a68c-4688-9055-69dda63b6b4c/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Start _get_guest_xml network_info=[{"id": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "address": "fa:16:3e:e7:42:bf", "network": {"id": "1c0cc61f-f779-4846-a964-db0ac1ed358a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1209595465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b1b51e818e442ab5d4b68fede61c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b984e7-f1", "ovs_interfaceid": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyFrHfeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '093deaa6-a68c-4688-9055-69dda63b6b4c', 'attached_at': '', 'detached_at': '', 'volume_id': '92ccb270-8b75-445c-b80f-4af3ec1018db', 'serial': '92ccb270-8b75-445c-b80f-4af3ec1018db'}, 'delete_on_termination': True, 'attachment_id': '8044835c-60b7-4327-a1ec-818b16486fff', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:14:54 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:14:54 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyFrHfeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:14:54 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:14:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:14:54 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:14:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:14:54 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[65768533-cf98-43c8-80b8-5e37f21b34ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:14:54 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb7714a-2e3c-4364-b627-570eb5a42ad5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db] added
Nov 30 07:14:54 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1780efe1-d66c-4861-87f0-3a7099cfbe86]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0e8841-efcf-42d1-a6d9-e7ce9195065e]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tyFrHfeI {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tyFrHfeI" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4100224-e5d0-4cd8-ba34-1a66a8acf4da]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tyFrHfeI'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca92f75-6d61-4958-b283-c2a64e19eb53]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bebffe-95bf-4009-a60f-e86a7ce4ea35]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:14:55 user nova-compute[75293]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:14:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:14:55 user nova-compute[75293]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:14:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d95f82-2a33-41e0-a6f3-f0f834a68d65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db, portal: 172.16.0.220,3260]
Nov 30 07:14:55 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db, portal: 172.16.0.220,3260] successful.
Nov 30 07:14:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:55 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:14:55 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:14:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=7710MB free_disk=25.285606384277344GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85d78e1-3619-4ba3-9a1e-62f4029fd0fe]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5497f43a-5cb3-418d-a202-25d832e495da]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:14:55 user nova-compute[75293]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:14:55 user nova-compute[75293]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:14:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:14:55 user nova-compute[75293]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:14:55 user nova-compute[75293]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:14:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.726s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38ee7aa-f138-4181-bea6-6bb907177980]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyFrHfeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b7deb0a-39af-4d93-b93d-5765a731f702 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 009f70bc-7561-48fe-ba47-ebaf4d81d462 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance c8d1df78-2aa2-4710-a570-5f72c60cfc26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9295d423-d71c-436b-9306-e0b386a0011f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 677602ec-88fd-4026-8112-8469855f8a78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 39042069-ac9b-4b13-b486-c845e84ac041 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance d34f99fc-343e-4e8a-83e6-372b0326bded actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 093deaa6-a68c-4688-9055-69dda63b6b4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:14:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.432s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.781s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] <== connect_volume: return (1784ms) {'type': 'block', 'scsi_wwn': '26130633766326663', 'path': '/dev/sdc'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130633766326663', 'path': '/dev/sdc'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1383728389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1383728389',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkH/W6LW/O9P0TOjpBNyg9mPCr0F5RhJ5UC+vXQMDgOyUkNDLXMoQER4Pxz+57oxrldBInLqlDI69s4mUYzIevfjGRYjiPK6uYw3Yx4XEko0at9i+vwqVvb+4cGOb36ig==',key_name='tempest-keypair-558954396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30b1b51e818e442ab5d4b68fede61c3b',ramdisk_id='',reservation_id='r-1o3nhquy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-766996460',owner_user_name='tempest-ServerActionsV293TestJSON-766996460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9359a918c1394350baf3814eac14c8f6',uuid=093deaa6-a68c-4688-9055-69dda63b6b4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "address": "fa:16:3e:e7:42:bf", "network": {"id": "1c0cc61f-f779-4846-a964-db0ac1ed358a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1209595465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b1b51e818e442ab5d4b68fede61c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b984e7-f1", "ovs_interfaceid": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Converting VIF {"id": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "address": "fa:16:3e:e7:42:bf", "network": {"id": "1c0cc61f-f779-4846-a964-db0ac1ed358a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1209595465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b1b51e818e442ab5d4b68fede61c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b984e7-f1", "ovs_interfaceid": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:42:bf,bridge_name='br-int',has_traffic_filtering=True,id=23b984e7-f18d-4c93-9720-0184ff3d6e0a,network=Network(1c0cc61f-f779-4846-a964-db0ac1ed358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b984e7-f1') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG nova.objects.instance [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lazy-loading 'pci_devices' on Instance uuid 093deaa6-a68c-4688-9055-69dda63b6b4c {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:14:56 user nova-compute[75293]:   <uuid>093deaa6-a68c-4688-9055-69dda63b6b4c</uuid>
Nov 30 07:14:56 user nova-compute[75293]:   <name>instance-00000016</name>
Nov 30 07:14:56 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:14:56 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:14:56 user nova-compute[75293]:   <metadata>
Nov 30 07:14:56 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:14:56 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:14:56 user nova-compute[75293]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1383728389</nova:name>
Nov 30 07:14:56 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:14:54</nova:creationTime>
Nov 30 07:14:56 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:14:56 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:14:56 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:14:56 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:14:56 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:14:56 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:14:56 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:14:56 user nova-compute[75293]:       <nova:owner>
Nov 30 07:14:56 user nova-compute[75293]:         <nova:user uuid="9359a918c1394350baf3814eac14c8f6">tempest-ServerActionsV293TestJSON-766996460-project-member</nova:user>
Nov 30 07:14:56 user nova-compute[75293]:         <nova:project uuid="30b1b51e818e442ab5d4b68fede61c3b">tempest-ServerActionsV293TestJSON-766996460</nova:project>
Nov 30 07:14:56 user nova-compute[75293]:       </nova:owner>
Nov 30 07:14:56 user nova-compute[75293]:       <nova:ports>
Nov 30 07:14:56 user nova-compute[75293]:         <nova:port uuid="23b984e7-f18d-4c93-9720-0184ff3d6e0a">
Nov 30 07:14:56 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 07:14:56 user nova-compute[75293]:         </nova:port>
Nov 30 07:14:56 user nova-compute[75293]:       </nova:ports>
Nov 30 07:14:56 user nova-compute[75293]:     </nova:instance>
Nov 30 07:14:56 user nova-compute[75293]:   </metadata>
Nov 30 07:14:56 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:14:56 user nova-compute[75293]:     <system>
Nov 30 07:14:56 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:14:56 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:14:56 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:14:56 user nova-compute[75293]:       <entry name="serial">093deaa6-a68c-4688-9055-69dda63b6b4c</entry>
Nov 30 07:14:56 user nova-compute[75293]:       <entry name="uuid">093deaa6-a68c-4688-9055-69dda63b6b4c</entry>
Nov 30 07:14:56 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:14:56 user nova-compute[75293]:     </system>
Nov 30 07:14:56 user nova-compute[75293]:   </sysinfo>
Nov 30 07:14:56 user nova-compute[75293]:   <os>
Nov 30 07:14:56 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:14:56 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:14:56 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:14:56 user nova-compute[75293]:   </os>
Nov 30 07:14:56 user nova-compute[75293]:   <features>
Nov 30 07:14:56 user nova-compute[75293]:     <acpi/>
Nov 30 07:14:56 user nova-compute[75293]:     <apic/>
Nov 30 07:14:56 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:14:56 user nova-compute[75293]:   </features>
Nov 30 07:14:56 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:14:56 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:14:56 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:14:56 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:14:56 user nova-compute[75293]:   </clock>
Nov 30 07:14:56 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:14:56 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:14:56 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:14:56 user nova-compute[75293]:   </cpu>
Nov 30 07:14:56 user nova-compute[75293]:   <devices>
Nov 30 07:14:56 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:14:56 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:14:56 user nova-compute[75293]:       <source dev="/dev/sdc"/>
Nov 30 07:14:56 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:14:56 user nova-compute[75293]:       <serial>92ccb270-8b75-445c-b80f-4af3ec1018db</serial>
Nov 30 07:14:56 user nova-compute[75293]:     </disk>
Nov 30 07:14:56 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:14:56 user nova-compute[75293]:       <mac address="fa:16:3e:e7:42:bf"/>
Nov 30 07:14:56 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:14:56 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:14:56 user nova-compute[75293]:       <target dev="tap23b984e7-f1"/>
Nov 30 07:14:56 user nova-compute[75293]:     </interface>
Nov 30 07:14:56 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:14:56 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/093deaa6-a68c-4688-9055-69dda63b6b4c/console.log" append="off"/>
Nov 30 07:14:56 user nova-compute[75293]:     </serial>
Nov 30 07:14:56 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:14:56 user nova-compute[75293]:     <video>
Nov 30 07:14:56 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:14:56 user nova-compute[75293]:     </video>
Nov 30 07:14:56 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:14:56 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:14:56 user nova-compute[75293]:     </rng>
Nov 30 07:14:56 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:14:56 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:14:56 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:14:56 user nova-compute[75293]:     </memballoon>
Nov 30 07:14:56 user nova-compute[75293]:   </devices>
Nov 30 07:14:56 user nova-compute[75293]: </domain>
Nov 30 07:14:56 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1383728389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1383728389',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkH/W6LW/O9P0TOjpBNyg9mPCr0F5RhJ5UC+vXQMDgOyUkNDLXMoQER4Pxz+57oxrldBInLqlDI69s4mUYzIevfjGRYjiPK6uYw3Yx4XEko0at9i+vwqVvb+4cGOb36ig==',key_name='tempest-keypair-558954396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30b1b51e818e442ab5d4b68fede61c3b',ramdisk_id='',reservation_id='r-1o3nhquy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-766996460',owner_user_name='tempest-ServerActionsV293TestJSON-766996460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9359a918c1394350baf3814eac14c8f6',uuid=093deaa6-a68c-4688-9055-69dda63b6b4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "address": "fa:16:3e:e7:42:bf", "network": {"id": "1c0cc61f-f779-4846-a964-db0ac1ed358a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1209595465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b1b51e818e442ab5d4b68fede61c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b984e7-f1", "ovs_interfaceid": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Converting VIF {"id": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "address": "fa:16:3e:e7:42:bf", "network": {"id": "1c0cc61f-f779-4846-a964-db0ac1ed358a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1209595465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b1b51e818e442ab5d4b68fede61c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b984e7-f1", "ovs_interfaceid": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:42:bf,bridge_name='br-int',has_traffic_filtering=True,id=23b984e7-f18d-4c93-9720-0184ff3d6e0a,network=Network(1c0cc61f-f779-4846-a964-db0ac1ed358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b984e7-f1') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG os_vif [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:42:bf,bridge_name='br-int',has_traffic_filtering=True,id=23b984e7-f18d-4c93-9720-0184ff3d6e0a,network=Network(1c0cc61f-f779-4846-a964-db0ac1ed358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b984e7-f1') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79cbfa55-8c16-5ab7-9181-3a7d04f478d5', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23b984e7-f1, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23b984e7-f1, col_values=(('qos', UUID('5d76035b-193d-4eb5-b38b-bb1420f393d8')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23b984e7-f1, col_values=(('external_ids', {'iface-id': '23b984e7-f18d-4c93-9720-0184ff3d6e0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:42:bf', 'vm-uuid': '093deaa6-a68c-4688-9055-69dda63b6b4c'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:56 user nova-compute[75293]: INFO os_vif [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:42:bf,bridge_name='br-int',has_traffic_filtering=True,id=23b984e7-f18d-4c93-9720-0184ff3d6e0a,network=Network(1c0cc61f-f779-4846-a964-db0ac1ed358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b984e7-f1')
Nov 30 07:14:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:14:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] No VIF found with MAC fa:16:3e:e7:42:bf, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:14:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:58 user nova-compute[75293]: DEBUG nova.compute.manager [req-86047e3b-b87b-4ceb-b2d6-55dcc4df2b17 req-52c811a0-5851-4e66-bb2e-7dec494959e1 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received event network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:14:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-86047e3b-b87b-4ceb-b2d6-55dcc4df2b17 req-52c811a0-5851-4e66-bb2e-7dec494959e1 service nova] Acquiring lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:14:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-86047e3b-b87b-4ceb-b2d6-55dcc4df2b17 req-52c811a0-5851-4e66-bb2e-7dec494959e1 service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:14:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-86047e3b-b87b-4ceb-b2d6-55dcc4df2b17 req-52c811a0-5851-4e66-bb2e-7dec494959e1 service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:14:58 user nova-compute[75293]: DEBUG nova.compute.manager [req-86047e3b-b87b-4ceb-b2d6-55dcc4df2b17 req-52c811a0-5851-4e66-bb2e-7dec494959e1 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] No waiting events found dispatching network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:14:58 user nova-compute[75293]: WARNING nova.compute.manager [req-86047e3b-b87b-4ceb-b2d6-55dcc4df2b17 req-52c811a0-5851-4e66-bb2e-7dec494959e1 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received unexpected event network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a for instance with vm_state building and task_state spawning.
Nov 30 07:14:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:14:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-9547515c-0570-444a-96f8-c9aa3bf7d97c req-7639b487-de17-4446-bab7-aaf2380c1fed service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received event network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:15:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9547515c-0570-444a-96f8-c9aa3bf7d97c req-7639b487-de17-4446-bab7-aaf2380c1fed service nova] Acquiring lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9547515c-0570-444a-96f8-c9aa3bf7d97c req-7639b487-de17-4446-bab7-aaf2380c1fed service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9547515c-0570-444a-96f8-c9aa3bf7d97c req-7639b487-de17-4446-bab7-aaf2380c1fed service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-9547515c-0570-444a-96f8-c9aa3bf7d97c req-7639b487-de17-4446-bab7-aaf2380c1fed service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] No waiting events found dispatching network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:15:00 user nova-compute[75293]: WARNING nova.compute.manager [req-9547515c-0570-444a-96f8-c9aa3bf7d97c req-7639b487-de17-4446-bab7-aaf2380c1fed service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received unexpected event network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a for instance with vm_state building and task_state spawning.
Nov 30 07:15:00 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:15:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:15:00 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Instance spawned successfully.
Nov 30 07:15:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:15:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:00 user nova-compute[75293]: INFO nova.compute.manager [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 30 07:15:00 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:15:00 user nova-compute[75293]: INFO nova.compute.manager [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Took 16.57 seconds to build instance.
Nov 30 07:15:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d77b3684-8eed-4a58-8166-4467359c2a61 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.673s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "4be43bb1-b17c-40b9-953a-c820f2396176" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "4be43bb1-b17c-40b9-953a-c820f2396176" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:06 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:15:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:06 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:15:06 user nova-compute[75293]: INFO nova.compute.claims [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Claim successful on node user
Nov 30 07:15:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:06 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:15:06 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:15:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:06 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:15:06 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:15:06 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:15:06 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:15:06 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:15:06 user nova-compute[75293]: DEBUG nova.policy [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abe34a1b2c38472d831ae5d7afa85c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ff34b2e2c047319c1fe166c5029790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:15:06 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:15:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:15:06 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Creating image(s)
Nov 30 07:15:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "/opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "/opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "/opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.226s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.186s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk 1073741824" returned: 0 in 0.051s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Successfully created port: 3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.172s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Cannot resize image /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Ensure instance console log exists: /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Successfully updated port: 3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "refresh_cache-4be43bb1-b17c-40b9-953a-c820f2396176" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquired lock "refresh_cache-4be43bb1-b17c-40b9-953a-c820f2396176" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-ca0fd40f-a5a4-49d0-a17e-9143920617c9 req-f5203666-e54a-45f4-b804-7b0d0134689f service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Received event network-changed-3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-ca0fd40f-a5a4-49d0-a17e-9143920617c9 req-f5203666-e54a-45f4-b804-7b0d0134689f service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Refreshing instance network info cache due to event network-changed-3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ca0fd40f-a5a4-49d0-a17e-9143920617c9 req-f5203666-e54a-45f4-b804-7b0d0134689f service nova] Acquiring lock "refresh_cache-4be43bb1-b17c-40b9-953a-c820f2396176" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Updating instance_info_cache with network_info: [{"id": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "address": "fa:16:3e:09:2f:cb", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10da91-4b", "ovs_interfaceid": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Releasing lock "refresh_cache-4be43bb1-b17c-40b9-953a-c820f2396176" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Instance network_info: |[{"id": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "address": "fa:16:3e:09:2f:cb", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10da91-4b", "ovs_interfaceid": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ca0fd40f-a5a4-49d0-a17e-9143920617c9 req-f5203666-e54a-45f4-b804-7b0d0134689f service nova] Acquired lock "refresh_cache-4be43bb1-b17c-40b9-953a-c820f2396176" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.network.neutron [req-ca0fd40f-a5a4-49d0-a17e-9143920617c9 req-f5203666-e54a-45f4-b804-7b0d0134689f service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Refreshing network info cache for port 3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Start _get_guest_xml network_info=[{"id": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "address": "fa:16:3e:09:2f:cb", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10da91-4b", "ovs_interfaceid": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:15:08 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:15:08 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1748796169',display_name='tempest-AttachVolumeNegativeTest-server-1748796169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1748796169',id=23,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjfec5PvW0Fp+MpU4gl0VZp6BjC3rHYkV0mSB12dv0FUDuwAqumheUSJGBCvYzMOld6p5oCb7SG8nFmC2LBatm1iUEQczWEQh95A57kj60vwFJEb2aX5jdwbickuyZP7w==',key_name='tempest-keypair-1131404555',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68ff34b2e2c047319c1fe166c5029790',ramdisk_id='',reservation_id='r-r8o6zt77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1915468397',owner_user_name='tempest-AttachVolumeNegativeTest-1915468397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:15:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe34a1b2c38472d831ae5d7afa85c77',uuid=4be43bb1-b17c-40b9-953a-c820f2396176,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "address": "fa:16:3e:09:2f:cb", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10da91-4b", "ovs_interfaceid": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converting VIF {"id": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "address": "fa:16:3e:09:2f:cb", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10da91-4b", "ovs_interfaceid": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:2f:cb,bridge_name='br-int',has_traffic_filtering=True,id=3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f10da91-4b') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.objects.instance [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lazy-loading 'pci_devices' on Instance uuid 4be43bb1-b17c-40b9-953a-c820f2396176 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:15:08 user nova-compute[75293]:   <uuid>4be43bb1-b17c-40b9-953a-c820f2396176</uuid>
Nov 30 07:15:08 user nova-compute[75293]:   <name>instance-00000017</name>
Nov 30 07:15:08 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:15:08 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:15:08 user nova-compute[75293]:   <metadata>
Nov 30 07:15:08 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:15:08 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:15:08 user nova-compute[75293]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1748796169</nova:name>
Nov 30 07:15:08 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:15:08</nova:creationTime>
Nov 30 07:15:08 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:15:08 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:15:08 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:15:08 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:15:08 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:15:08 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:15:08 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:15:08 user nova-compute[75293]:       <nova:owner>
Nov 30 07:15:08 user nova-compute[75293]:         <nova:user uuid="abe34a1b2c38472d831ae5d7afa85c77">tempest-AttachVolumeNegativeTest-1915468397-project-member</nova:user>
Nov 30 07:15:08 user nova-compute[75293]:         <nova:project uuid="68ff34b2e2c047319c1fe166c5029790">tempest-AttachVolumeNegativeTest-1915468397</nova:project>
Nov 30 07:15:08 user nova-compute[75293]:       </nova:owner>
Nov 30 07:15:08 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:15:08 user nova-compute[75293]:       <nova:ports>
Nov 30 07:15:08 user nova-compute[75293]:         <nova:port uuid="3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4">
Nov 30 07:15:08 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 07:15:08 user nova-compute[75293]:         </nova:port>
Nov 30 07:15:08 user nova-compute[75293]:       </nova:ports>
Nov 30 07:15:08 user nova-compute[75293]:     </nova:instance>
Nov 30 07:15:08 user nova-compute[75293]:   </metadata>
Nov 30 07:15:08 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:15:08 user nova-compute[75293]:     <system>
Nov 30 07:15:08 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:15:08 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:15:08 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:15:08 user nova-compute[75293]:       <entry name="serial">4be43bb1-b17c-40b9-953a-c820f2396176</entry>
Nov 30 07:15:08 user nova-compute[75293]:       <entry name="uuid">4be43bb1-b17c-40b9-953a-c820f2396176</entry>
Nov 30 07:15:08 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:15:08 user nova-compute[75293]:     </system>
Nov 30 07:15:08 user nova-compute[75293]:   </sysinfo>
Nov 30 07:15:08 user nova-compute[75293]:   <os>
Nov 30 07:15:08 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:15:08 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:15:08 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:15:08 user nova-compute[75293]:   </os>
Nov 30 07:15:08 user nova-compute[75293]:   <features>
Nov 30 07:15:08 user nova-compute[75293]:     <acpi/>
Nov 30 07:15:08 user nova-compute[75293]:     <apic/>
Nov 30 07:15:08 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:15:08 user nova-compute[75293]:   </features>
Nov 30 07:15:08 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:15:08 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:15:08 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:15:08 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:15:08 user nova-compute[75293]:   </clock>
Nov 30 07:15:08 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:15:08 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:15:08 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:15:08 user nova-compute[75293]:   </cpu>
Nov 30 07:15:08 user nova-compute[75293]:   <devices>
Nov 30 07:15:08 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:15:08 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:15:08 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk"/>
Nov 30 07:15:08 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:15:08 user nova-compute[75293]:     </disk>
Nov 30 07:15:08 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:15:08 user nova-compute[75293]:       <mac address="fa:16:3e:09:2f:cb"/>
Nov 30 07:15:08 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:15:08 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:15:08 user nova-compute[75293]:       <target dev="tap3f10da91-4b"/>
Nov 30 07:15:08 user nova-compute[75293]:     </interface>
Nov 30 07:15:08 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:15:08 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/console.log" append="off"/>
Nov 30 07:15:08 user nova-compute[75293]:     </serial>
Nov 30 07:15:08 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:15:08 user nova-compute[75293]:     <video>
Nov 30 07:15:08 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:15:08 user nova-compute[75293]:     </video>
Nov 30 07:15:08 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:15:08 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:15:08 user nova-compute[75293]:     </rng>
Nov 30 07:15:08 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:15:08 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:15:08 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:15:08 user nova-compute[75293]:     </memballoon>
Nov 30 07:15:08 user nova-compute[75293]:   </devices>
Nov 30 07:15:08 user nova-compute[75293]: </domain>
Nov 30 07:15:08 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1748796169',display_name='tempest-AttachVolumeNegativeTest-server-1748796169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1748796169',id=23,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjfec5PvW0Fp+MpU4gl0VZp6BjC3rHYkV0mSB12dv0FUDuwAqumheUSJGBCvYzMOld6p5oCb7SG8nFmC2LBatm1iUEQczWEQh95A57kj60vwFJEb2aX5jdwbickuyZP7w==',key_name='tempest-keypair-1131404555',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68ff34b2e2c047319c1fe166c5029790',ramdisk_id='',reservation_id='r-r8o6zt77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1915468397',owner_user_name='tempest-AttachVolumeNegativeTest-1915468397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:15:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe34a1b2c38472d831ae5d7afa85c77',uuid=4be43bb1-b17c-40b9-953a-c820f2396176,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "address": "fa:16:3e:09:2f:cb", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10da91-4b", "ovs_interfaceid": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converting VIF {"id": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "address": "fa:16:3e:09:2f:cb", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10da91-4b", "ovs_interfaceid": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:2f:cb,bridge_name='br-int',has_traffic_filtering=True,id=3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f10da91-4b') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG os_vif [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:2f:cb,bridge_name='br-int',has_traffic_filtering=True,id=3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f10da91-4b') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7911e037-ea54-5796-9e6a-ae3693b1d13a', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f10da91-4b, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f10da91-4b, col_values=(('qos', UUID('4cc5b09c-852a-45de-b886-a062155f024f')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f10da91-4b, col_values=(('external_ids', {'iface-id': '3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:2f:cb', 'vm-uuid': '4be43bb1-b17c-40b9-953a-c820f2396176'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:08 user nova-compute[75293]: INFO os_vif [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:2f:cb,bridge_name='br-int',has_traffic_filtering=True,id=3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f10da91-4b')
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] No VIF found with MAC fa:16:3e:09:2f:cb, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.network.neutron [req-ca0fd40f-a5a4-49d0-a17e-9143920617c9 req-f5203666-e54a-45f4-b804-7b0d0134689f service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Updated VIF entry in instance network info cache for port 3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:15:08 user nova-compute[75293]: DEBUG nova.network.neutron [req-ca0fd40f-a5a4-49d0-a17e-9143920617c9 req-f5203666-e54a-45f4-b804-7b0d0134689f service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Updating instance_info_cache with network_info: [{"id": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "address": "fa:16:3e:09:2f:cb", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10da91-4b", "ovs_interfaceid": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:15:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ca0fd40f-a5a4-49d0-a17e-9143920617c9 req-f5203666-e54a-45f4-b804-7b0d0134689f service nova] Releasing lock "refresh_cache-4be43bb1-b17c-40b9-953a-c820f2396176" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:15:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:10 user nova-compute[75293]: DEBUG nova.compute.manager [req-84fe19a6-db03-4e85-a699-ea8cd8817efc req-9c329c74-e476-48bb-892f-4972cfc95fa5 service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Received event network-vif-plugged-3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:15:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-84fe19a6-db03-4e85-a699-ea8cd8817efc req-9c329c74-e476-48bb-892f-4972cfc95fa5 service nova] Acquiring lock "4be43bb1-b17c-40b9-953a-c820f2396176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-84fe19a6-db03-4e85-a699-ea8cd8817efc req-9c329c74-e476-48bb-892f-4972cfc95fa5 service nova] Lock "4be43bb1-b17c-40b9-953a-c820f2396176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-84fe19a6-db03-4e85-a699-ea8cd8817efc req-9c329c74-e476-48bb-892f-4972cfc95fa5 service nova] Lock "4be43bb1-b17c-40b9-953a-c820f2396176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:10 user nova-compute[75293]: DEBUG nova.compute.manager [req-84fe19a6-db03-4e85-a699-ea8cd8817efc req-9c329c74-e476-48bb-892f-4972cfc95fa5 service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] No waiting events found dispatching network-vif-plugged-3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:15:10 user nova-compute[75293]: WARNING nova.compute.manager [req-84fe19a6-db03-4e85-a699-ea8cd8817efc req-9c329c74-e476-48bb-892f-4972cfc95fa5 service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Received unexpected event network-vif-plugged-3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4 for instance with vm_state building and task_state spawning.
Nov 30 07:15:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:12 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:15:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:15:12 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Instance spawned successfully.
Nov 30 07:15:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:15:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:12 user nova-compute[75293]: DEBUG nova.compute.manager [req-e80cb384-9640-41d2-86cf-11340c8f33f3 req-f813704d-fd73-4183-ae31-b3374801a8c7 service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Received event network-vif-plugged-3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:15:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e80cb384-9640-41d2-86cf-11340c8f33f3 req-f813704d-fd73-4183-ae31-b3374801a8c7 service nova] Acquiring lock "4be43bb1-b17c-40b9-953a-c820f2396176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e80cb384-9640-41d2-86cf-11340c8f33f3 req-f813704d-fd73-4183-ae31-b3374801a8c7 service nova] Lock "4be43bb1-b17c-40b9-953a-c820f2396176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e80cb384-9640-41d2-86cf-11340c8f33f3 req-f813704d-fd73-4183-ae31-b3374801a8c7 service nova] Lock "4be43bb1-b17c-40b9-953a-c820f2396176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:12 user nova-compute[75293]: DEBUG nova.compute.manager [req-e80cb384-9640-41d2-86cf-11340c8f33f3 req-f813704d-fd73-4183-ae31-b3374801a8c7 service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] No waiting events found dispatching network-vif-plugged-3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:15:12 user nova-compute[75293]: WARNING nova.compute.manager [req-e80cb384-9640-41d2-86cf-11340c8f33f3 req-f813704d-fd73-4183-ae31-b3374801a8c7 service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Received unexpected event network-vif-plugged-3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4 for instance with vm_state building and task_state spawning.
Nov 30 07:15:12 user nova-compute[75293]: INFO nova.compute.manager [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 30 07:15:12 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:15:12 user nova-compute[75293]: INFO nova.compute.manager [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Took 6.57 seconds to build instance.
Nov 30 07:15:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f821c42c-ccd8-400c-ade7-f13cc1fe0624 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "4be43bb1-b17c-40b9-953a-c820f2396176" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.796s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquiring lock "5576f436-247d-461d-9859-f9bb3ee4fa18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "5576f436-247d-461d-9859-f9bb3ee4fa18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:13 user nova-compute[75293]: DEBUG nova.compute.manager [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:15:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:13 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:15:13 user nova-compute[75293]: INFO nova.compute.claims [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Claim successful on node user
Nov 30 07:15:14 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:15:14 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:15:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.842s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:14 user nova-compute[75293]: DEBUG nova.compute.manager [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:15:14 user nova-compute[75293]: DEBUG nova.compute.manager [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:15:14 user nova-compute[75293]: DEBUG nova.network.neutron [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:15:15 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:15:15 user nova-compute[75293]: DEBUG nova.compute.manager [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:15:15 user nova-compute[75293]: DEBUG nova.policy [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09ce91e4a92b4ee9acd2c4c9929574ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379a38913c014e62b5b0256318c92dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:15:15 user nova-compute[75293]: DEBUG nova.compute.manager [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:15:15 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:15:15 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Creating image(s)
Nov 30 07:15:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquiring lock "/opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "/opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "/opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.219s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.199s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/disk 1073741824" returned: 0 in 0.054s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.234s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG nova.network.neutron [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Successfully created port: 74083f81-5c90-4bbb-a53d-4e910a926b42 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Cannot resize image /opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Ensure instance console log exists: /opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:17 user nova-compute[75293]: DEBUG nova.network.neutron [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Successfully updated port: 74083f81-5c90-4bbb-a53d-4e910a926b42 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:15:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquiring lock "refresh_cache-5576f436-247d-461d-9859-f9bb3ee4fa18" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:15:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquired lock "refresh_cache-5576f436-247d-461d-9859-f9bb3ee4fa18" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:15:17 user nova-compute[75293]: DEBUG nova.network.neutron [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:15:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-7aefc2f8-a056-41a2-be1d-9a9f66db75bc req-b0be1b1a-02e2-4de7-9468-ba873380169b service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Received event network-changed-74083f81-5c90-4bbb-a53d-4e910a926b42 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:15:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-7aefc2f8-a056-41a2-be1d-9a9f66db75bc req-b0be1b1a-02e2-4de7-9468-ba873380169b service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Refreshing instance network info cache due to event network-changed-74083f81-5c90-4bbb-a53d-4e910a926b42. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:15:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7aefc2f8-a056-41a2-be1d-9a9f66db75bc req-b0be1b1a-02e2-4de7-9468-ba873380169b service nova] Acquiring lock "refresh_cache-5576f436-247d-461d-9859-f9bb3ee4fa18" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:15:17 user nova-compute[75293]: DEBUG nova.network.neutron [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.network.neutron [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Updating instance_info_cache with network_info: [{"id": "74083f81-5c90-4bbb-a53d-4e910a926b42", "address": "fa:16:3e:59:9c:33", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74083f81-5c", "ovs_interfaceid": "74083f81-5c90-4bbb-a53d-4e910a926b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Releasing lock "refresh_cache-5576f436-247d-461d-9859-f9bb3ee4fa18" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.compute.manager [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Instance network_info: |[{"id": "74083f81-5c90-4bbb-a53d-4e910a926b42", "address": "fa:16:3e:59:9c:33", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74083f81-5c", "ovs_interfaceid": "74083f81-5c90-4bbb-a53d-4e910a926b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7aefc2f8-a056-41a2-be1d-9a9f66db75bc req-b0be1b1a-02e2-4de7-9468-ba873380169b service nova] Acquired lock "refresh_cache-5576f436-247d-461d-9859-f9bb3ee4fa18" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.network.neutron [req-7aefc2f8-a056-41a2-be1d-9a9f66db75bc req-b0be1b1a-02e2-4de7-9468-ba873380169b service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Refreshing network info cache for port 74083f81-5c90-4bbb-a53d-4e910a926b42 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Start _get_guest_xml network_info=[{"id": "74083f81-5c90-4bbb-a53d-4e910a926b42", "address": "fa:16:3e:59:9c:33", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74083f81-5c", "ovs_interfaceid": "74083f81-5c90-4bbb-a53d-4e910a926b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:15:18 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:15:18 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:15:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-571287958',display_name='tempest-VolumesActionsTest-instance-571287958',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-571287958',id=24,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='379a38913c014e62b5b0256318c92dd8',ramdisk_id='',reservation_id='r-hi5b53ri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2065132499',owner_user_name='tempest-VolumesActionsTest-2065132499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:15:16Z,user_data=None,user_id='09ce91e4a92b4ee9acd2c4c9929574ff',uuid=5576f436-247d-461d-9859-f9bb3ee4fa18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74083f81-5c90-4bbb-a53d-4e910a926b42", "address": "fa:16:3e:59:9c:33", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74083f81-5c", "ovs_interfaceid": "74083f81-5c90-4bbb-a53d-4e910a926b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Converting VIF {"id": "74083f81-5c90-4bbb-a53d-4e910a926b42", "address": "fa:16:3e:59:9c:33", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74083f81-5c", "ovs_interfaceid": "74083f81-5c90-4bbb-a53d-4e910a926b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:9c:33,bridge_name='br-int',has_traffic_filtering=True,id=74083f81-5c90-4bbb-a53d-4e910a926b42,network=Network(9d47d272-ffeb-4f6c-9246-2acefdf615a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74083f81-5c') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.objects.instance [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lazy-loading 'pci_devices' on Instance uuid 5576f436-247d-461d-9859-f9bb3ee4fa18 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:15:18 user nova-compute[75293]:   <uuid>5576f436-247d-461d-9859-f9bb3ee4fa18</uuid>
Nov 30 07:15:18 user nova-compute[75293]:   <name>instance-00000018</name>
Nov 30 07:15:18 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:15:18 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:15:18 user nova-compute[75293]:   <metadata>
Nov 30 07:15:18 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:15:18 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:15:18 user nova-compute[75293]:       <nova:name>tempest-VolumesActionsTest-instance-571287958</nova:name>
Nov 30 07:15:18 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:15:18</nova:creationTime>
Nov 30 07:15:18 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:15:18 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:15:18 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:15:18 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:15:18 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:15:18 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:15:18 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:15:18 user nova-compute[75293]:       <nova:owner>
Nov 30 07:15:18 user nova-compute[75293]:         <nova:user uuid="09ce91e4a92b4ee9acd2c4c9929574ff">tempest-VolumesActionsTest-2065132499-project-member</nova:user>
Nov 30 07:15:18 user nova-compute[75293]:         <nova:project uuid="379a38913c014e62b5b0256318c92dd8">tempest-VolumesActionsTest-2065132499</nova:project>
Nov 30 07:15:18 user nova-compute[75293]:       </nova:owner>
Nov 30 07:15:18 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:15:18 user nova-compute[75293]:       <nova:ports>
Nov 30 07:15:18 user nova-compute[75293]:         <nova:port uuid="74083f81-5c90-4bbb-a53d-4e910a926b42">
Nov 30 07:15:18 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 07:15:18 user nova-compute[75293]:         </nova:port>
Nov 30 07:15:18 user nova-compute[75293]:       </nova:ports>
Nov 30 07:15:18 user nova-compute[75293]:     </nova:instance>
Nov 30 07:15:18 user nova-compute[75293]:   </metadata>
Nov 30 07:15:18 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:15:18 user nova-compute[75293]:     <system>
Nov 30 07:15:18 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:15:18 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:15:18 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:15:18 user nova-compute[75293]:       <entry name="serial">5576f436-247d-461d-9859-f9bb3ee4fa18</entry>
Nov 30 07:15:18 user nova-compute[75293]:       <entry name="uuid">5576f436-247d-461d-9859-f9bb3ee4fa18</entry>
Nov 30 07:15:18 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:15:18 user nova-compute[75293]:     </system>
Nov 30 07:15:18 user nova-compute[75293]:   </sysinfo>
Nov 30 07:15:18 user nova-compute[75293]:   <os>
Nov 30 07:15:18 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:15:18 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:15:18 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:15:18 user nova-compute[75293]:   </os>
Nov 30 07:15:18 user nova-compute[75293]:   <features>
Nov 30 07:15:18 user nova-compute[75293]:     <acpi/>
Nov 30 07:15:18 user nova-compute[75293]:     <apic/>
Nov 30 07:15:18 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:15:18 user nova-compute[75293]:   </features>
Nov 30 07:15:18 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:15:18 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:15:18 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:15:18 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:15:18 user nova-compute[75293]:   </clock>
Nov 30 07:15:18 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:15:18 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:15:18 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:15:18 user nova-compute[75293]:   </cpu>
Nov 30 07:15:18 user nova-compute[75293]:   <devices>
Nov 30 07:15:18 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:15:18 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:15:18 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/disk"/>
Nov 30 07:15:18 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:15:18 user nova-compute[75293]:     </disk>
Nov 30 07:15:18 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:15:18 user nova-compute[75293]:       <mac address="fa:16:3e:59:9c:33"/>
Nov 30 07:15:18 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:15:18 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:15:18 user nova-compute[75293]:       <target dev="tap74083f81-5c"/>
Nov 30 07:15:18 user nova-compute[75293]:     </interface>
Nov 30 07:15:18 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:15:18 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/console.log" append="off"/>
Nov 30 07:15:18 user nova-compute[75293]:     </serial>
Nov 30 07:15:18 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:15:18 user nova-compute[75293]:     <video>
Nov 30 07:15:18 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:15:18 user nova-compute[75293]:     </video>
Nov 30 07:15:18 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:15:18 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:15:18 user nova-compute[75293]:     </rng>
Nov 30 07:15:18 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:15:18 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:15:18 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:15:18 user nova-compute[75293]:     </memballoon>
Nov 30 07:15:18 user nova-compute[75293]:   </devices>
Nov 30 07:15:18 user nova-compute[75293]: </domain>
Nov 30 07:15:18 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:15:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-571287958',display_name='tempest-VolumesActionsTest-instance-571287958',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-571287958',id=24,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='379a38913c014e62b5b0256318c92dd8',ramdisk_id='',reservation_id='r-hi5b53ri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2065132499',owner_user_name='tempest-VolumesActionsTest-2065132499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:15:16Z,user_data=None,user_id='09ce91e4a92b4ee9acd2c4c9929574ff',uuid=5576f436-247d-461d-9859-f9bb3ee4fa18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74083f81-5c90-4bbb-a53d-4e910a926b42", "address": "fa:16:3e:59:9c:33", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74083f81-5c", "ovs_interfaceid": "74083f81-5c90-4bbb-a53d-4e910a926b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Converting VIF {"id": "74083f81-5c90-4bbb-a53d-4e910a926b42", "address": "fa:16:3e:59:9c:33", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74083f81-5c", "ovs_interfaceid": "74083f81-5c90-4bbb-a53d-4e910a926b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:9c:33,bridge_name='br-int',has_traffic_filtering=True,id=74083f81-5c90-4bbb-a53d-4e910a926b42,network=Network(9d47d272-ffeb-4f6c-9246-2acefdf615a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74083f81-5c') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG os_vif [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:9c:33,bridge_name='br-int',has_traffic_filtering=True,id=74083f81-5c90-4bbb-a53d-4e910a926b42,network=Network(9d47d272-ffeb-4f6c-9246-2acefdf615a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74083f81-5c') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9b46585-033e-5cbf-9454-5abd92044815', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74083f81-5c, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74083f81-5c, col_values=(('qos', UUID('fb46b1cc-5844-4fe2-a1a0-451e0d14284a')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74083f81-5c, col_values=(('external_ids', {'iface-id': '74083f81-5c90-4bbb-a53d-4e910a926b42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:9c:33', 'vm-uuid': '5576f436-247d-461d-9859-f9bb3ee4fa18'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:18 user nova-compute[75293]: INFO os_vif [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:9c:33,bridge_name='br-int',has_traffic_filtering=True,id=74083f81-5c90-4bbb-a53d-4e910a926b42,network=Network(9d47d272-ffeb-4f6c-9246-2acefdf615a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74083f81-5c')
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] No VIF found with MAC fa:16:3e:59:9c:33, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.network.neutron [req-7aefc2f8-a056-41a2-be1d-9a9f66db75bc req-b0be1b1a-02e2-4de7-9468-ba873380169b service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Updated VIF entry in instance network info cache for port 74083f81-5c90-4bbb-a53d-4e910a926b42. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG nova.network.neutron [req-7aefc2f8-a056-41a2-be1d-9a9f66db75bc req-b0be1b1a-02e2-4de7-9468-ba873380169b service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Updating instance_info_cache with network_info: [{"id": "74083f81-5c90-4bbb-a53d-4e910a926b42", "address": "fa:16:3e:59:9c:33", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74083f81-5c", "ovs_interfaceid": "74083f81-5c90-4bbb-a53d-4e910a926b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:15:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7aefc2f8-a056-41a2-be1d-9a9f66db75bc req-b0be1b1a-02e2-4de7-9468-ba873380169b service nova] Releasing lock "refresh_cache-5576f436-247d-461d-9859-f9bb3ee4fa18" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:15:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-c1b6dc3e-eb77-4c98-a386-99c814028867 req-f6a17223-1f05-47e5-9e6d-2a09390fe448 service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Received event network-vif-plugged-74083f81-5c90-4bbb-a53d-4e910a926b42 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:15:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c1b6dc3e-eb77-4c98-a386-99c814028867 req-f6a17223-1f05-47e5-9e6d-2a09390fe448 service nova] Acquiring lock "5576f436-247d-461d-9859-f9bb3ee4fa18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c1b6dc3e-eb77-4c98-a386-99c814028867 req-f6a17223-1f05-47e5-9e6d-2a09390fe448 service nova] Lock "5576f436-247d-461d-9859-f9bb3ee4fa18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c1b6dc3e-eb77-4c98-a386-99c814028867 req-f6a17223-1f05-47e5-9e6d-2a09390fe448 service nova] Lock "5576f436-247d-461d-9859-f9bb3ee4fa18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-c1b6dc3e-eb77-4c98-a386-99c814028867 req-f6a17223-1f05-47e5-9e6d-2a09390fe448 service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] No waiting events found dispatching network-vif-plugged-74083f81-5c90-4bbb-a53d-4e910a926b42 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:15:20 user nova-compute[75293]: WARNING nova.compute.manager [req-c1b6dc3e-eb77-4c98-a386-99c814028867 req-f6a17223-1f05-47e5-9e6d-2a09390fe448 service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Received unexpected event network-vif-plugged-74083f81-5c90-4bbb-a53d-4e910a926b42 for instance with vm_state building and task_state spawning.
Nov 30 07:15:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:22 user nova-compute[75293]: DEBUG nova.compute.manager [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:15:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:15:22 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Instance spawned successfully.
Nov 30 07:15:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:15:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:22 user nova-compute[75293]: INFO nova.compute.manager [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 30 07:15:22 user nova-compute[75293]: DEBUG nova.compute.manager [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:15:22 user nova-compute[75293]: INFO nova.compute.manager [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Took 8.55 seconds to build instance.
Nov 30 07:15:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91b29418-b1ef-45ad-b508-a4e80608ee84 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "5576f436-247d-461d-9859-f9bb3ee4fa18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.658s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:22 user nova-compute[75293]: DEBUG nova.compute.manager [req-29ed8594-b2cb-4879-a2b3-a0e76d8cf358 req-563fbf63-937c-433e-801b-9cda533206dc service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Received event network-vif-plugged-74083f81-5c90-4bbb-a53d-4e910a926b42 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:15:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-29ed8594-b2cb-4879-a2b3-a0e76d8cf358 req-563fbf63-937c-433e-801b-9cda533206dc service nova] Acquiring lock "5576f436-247d-461d-9859-f9bb3ee4fa18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-29ed8594-b2cb-4879-a2b3-a0e76d8cf358 req-563fbf63-937c-433e-801b-9cda533206dc service nova] Lock "5576f436-247d-461d-9859-f9bb3ee4fa18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-29ed8594-b2cb-4879-a2b3-a0e76d8cf358 req-563fbf63-937c-433e-801b-9cda533206dc service nova] Lock "5576f436-247d-461d-9859-f9bb3ee4fa18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:22 user nova-compute[75293]: DEBUG nova.compute.manager [req-29ed8594-b2cb-4879-a2b3-a0e76d8cf358 req-563fbf63-937c-433e-801b-9cda533206dc service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] No waiting events found dispatching network-vif-plugged-74083f81-5c90-4bbb-a53d-4e910a926b42 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:15:22 user nova-compute[75293]: WARNING nova.compute.manager [req-29ed8594-b2cb-4879-a2b3-a0e76d8cf358 req-563fbf63-937c-433e-801b-9cda533206dc service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Received unexpected event network-vif-plugged-74083f81-5c90-4bbb-a53d-4e910a926b42 for instance with vm_state active and task_state None.
Nov 30 07:15:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquiring lock "ed037c80-4f33-4e03-907c-18b4ea122411" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "ed037c80-4f33-4e03-907c-18b4ea122411" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:25 user nova-compute[75293]: DEBUG nova.compute.manager [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:15:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:15:25 user nova-compute[75293]: INFO nova.compute.claims [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Claim successful on node user
Nov 30 07:15:25 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:15:25 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:15:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:25 user nova-compute[75293]: DEBUG nova.compute.manager [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:15:25 user nova-compute[75293]: DEBUG nova.compute.manager [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:15:25 user nova-compute[75293]: DEBUG nova.network.neutron [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:15:25 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:15:25 user nova-compute[75293]: DEBUG nova.compute.manager [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG nova.policy [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f04441af417245e2a68e11d52ad7b05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744f39a1f6d424fa13d77ed2ced51c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG nova.compute.manager [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:15:26 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Creating image(s)
Nov 30 07:15:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "/opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "/opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.196s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.212s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk 1073741824" returned: 0 in 0.083s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG nova.network.neutron [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Successfully created port: 196acf39-315e-4e6f-b324-b4e92ccdb6b8 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.222s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:15:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Cannot resize image /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Ensure instance console log exists: /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.005s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG nova.network.neutron [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Successfully updated port: 196acf39-315e-4e6f-b324-b4e92ccdb6b8 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquiring lock "refresh_cache-ed037c80-4f33-4e03-907c-18b4ea122411" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquired lock "refresh_cache-ed037c80-4f33-4e03-907c-18b4ea122411" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG nova.network.neutron [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG nova.compute.manager [req-20936d24-52fa-4791-833d-e9ee3f7d6beb req-6545eeaf-0fc9-4c4a-b976-87620f43f979 service nova] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Received event network-changed-196acf39-315e-4e6f-b324-b4e92ccdb6b8 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG nova.compute.manager [req-20936d24-52fa-4791-833d-e9ee3f7d6beb req-6545eeaf-0fc9-4c4a-b976-87620f43f979 service nova] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Refreshing instance network info cache due to event network-changed-196acf39-315e-4e6f-b324-b4e92ccdb6b8. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-20936d24-52fa-4791-833d-e9ee3f7d6beb req-6545eeaf-0fc9-4c4a-b976-87620f43f979 service nova] Acquiring lock "refresh_cache-ed037c80-4f33-4e03-907c-18b4ea122411" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG nova.network.neutron [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:15:27 user nova-compute[75293]: INFO nova.compute.claims [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Claim successful on node user
Nov 30 07:15:27 user nova-compute[75293]: DEBUG nova.network.neutron [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Updating instance_info_cache with network_info: [{"id": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "address": "fa:16:3e:fe:7a:56", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap196acf39-31", "ovs_interfaceid": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Releasing lock "refresh_cache-ed037c80-4f33-4e03-907c-18b4ea122411" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Instance network_info: |[{"id": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "address": "fa:16:3e:fe:7a:56", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap196acf39-31", "ovs_interfaceid": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-20936d24-52fa-4791-833d-e9ee3f7d6beb req-6545eeaf-0fc9-4c4a-b976-87620f43f979 service nova] Acquired lock "refresh_cache-ed037c80-4f33-4e03-907c-18b4ea122411" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG nova.network.neutron [req-20936d24-52fa-4791-833d-e9ee3f7d6beb req-6545eeaf-0fc9-4c4a-b976-87620f43f979 service nova] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Refreshing network info cache for port 196acf39-315e-4e6f-b324-b4e92ccdb6b8 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:15:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Start _get_guest_xml network_info=[{"id": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "address": "fa:16:3e:fe:7a:56", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap196acf39-31", "ovs_interfaceid": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:15:28 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:15:28 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-721563326',display_name='tempest-ServersNegativeTestJSON-server-721563326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-721563326',id=25,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8744f39a1f6d424fa13d77ed2ced51c5',ramdisk_id='',reservation_id='r-ww2rfr2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1767090220',owner_user_name='tempest-ServersNegativeTestJSON-1767090220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:15:26Z,user_data=None,user_id='f04441af417245e2a68e11d52ad7b05f',uuid=ed037c80-4f33-4e03-907c-18b4ea122411,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "address": "fa:16:3e:fe:7a:56", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap196acf39-31", "ovs_interfaceid": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Converting VIF {"id": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "address": "fa:16:3e:fe:7a:56", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap196acf39-31", "ovs_interfaceid": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:7a:56,bridge_name='br-int',has_traffic_filtering=True,id=196acf39-315e-4e6f-b324-b4e92ccdb6b8,network=Network(f557522c-aed7-4965-8036-cb4260a19168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap196acf39-31') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.objects.instance [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lazy-loading 'pci_devices' on Instance uuid ed037c80-4f33-4e03-907c-18b4ea122411 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:15:28 user nova-compute[75293]:   <uuid>ed037c80-4f33-4e03-907c-18b4ea122411</uuid>
Nov 30 07:15:28 user nova-compute[75293]:   <name>instance-00000019</name>
Nov 30 07:15:28 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:15:28 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:15:28 user nova-compute[75293]:   <metadata>
Nov 30 07:15:28 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:15:28 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:15:28 user nova-compute[75293]:       <nova:name>tempest-ServersNegativeTestJSON-server-721563326</nova:name>
Nov 30 07:15:28 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:15:28</nova:creationTime>
Nov 30 07:15:28 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:15:28 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:15:28 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:15:28 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:15:28 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:15:28 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:15:28 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:15:28 user nova-compute[75293]:       <nova:owner>
Nov 30 07:15:28 user nova-compute[75293]:         <nova:user uuid="f04441af417245e2a68e11d52ad7b05f">tempest-ServersNegativeTestJSON-1767090220-project-member</nova:user>
Nov 30 07:15:28 user nova-compute[75293]:         <nova:project uuid="8744f39a1f6d424fa13d77ed2ced51c5">tempest-ServersNegativeTestJSON-1767090220</nova:project>
Nov 30 07:15:28 user nova-compute[75293]:       </nova:owner>
Nov 30 07:15:28 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:15:28 user nova-compute[75293]:       <nova:ports>
Nov 30 07:15:28 user nova-compute[75293]:         <nova:port uuid="196acf39-315e-4e6f-b324-b4e92ccdb6b8">
Nov 30 07:15:28 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 07:15:28 user nova-compute[75293]:         </nova:port>
Nov 30 07:15:28 user nova-compute[75293]:       </nova:ports>
Nov 30 07:15:28 user nova-compute[75293]:     </nova:instance>
Nov 30 07:15:28 user nova-compute[75293]:   </metadata>
Nov 30 07:15:28 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:15:28 user nova-compute[75293]:     <system>
Nov 30 07:15:28 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:15:28 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:15:28 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:15:28 user nova-compute[75293]:       <entry name="serial">ed037c80-4f33-4e03-907c-18b4ea122411</entry>
Nov 30 07:15:28 user nova-compute[75293]:       <entry name="uuid">ed037c80-4f33-4e03-907c-18b4ea122411</entry>
Nov 30 07:15:28 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:15:28 user nova-compute[75293]:     </system>
Nov 30 07:15:28 user nova-compute[75293]:   </sysinfo>
Nov 30 07:15:28 user nova-compute[75293]:   <os>
Nov 30 07:15:28 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:15:28 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:15:28 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:15:28 user nova-compute[75293]:   </os>
Nov 30 07:15:28 user nova-compute[75293]:   <features>
Nov 30 07:15:28 user nova-compute[75293]:     <acpi/>
Nov 30 07:15:28 user nova-compute[75293]:     <apic/>
Nov 30 07:15:28 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:15:28 user nova-compute[75293]:   </features>
Nov 30 07:15:28 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:15:28 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:15:28 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:15:28 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:15:28 user nova-compute[75293]:   </clock>
Nov 30 07:15:28 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:15:28 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:15:28 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:15:28 user nova-compute[75293]:   </cpu>
Nov 30 07:15:28 user nova-compute[75293]:   <devices>
Nov 30 07:15:28 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:15:28 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:15:28 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk"/>
Nov 30 07:15:28 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:15:28 user nova-compute[75293]:     </disk>
Nov 30 07:15:28 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:15:28 user nova-compute[75293]:       <mac address="fa:16:3e:fe:7a:56"/>
Nov 30 07:15:28 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:15:28 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:15:28 user nova-compute[75293]:       <target dev="tap196acf39-31"/>
Nov 30 07:15:28 user nova-compute[75293]:     </interface>
Nov 30 07:15:28 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:15:28 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/console.log" append="off"/>
Nov 30 07:15:28 user nova-compute[75293]:     </serial>
Nov 30 07:15:28 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:15:28 user nova-compute[75293]:     <video>
Nov 30 07:15:28 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:15:28 user nova-compute[75293]:     </video>
Nov 30 07:15:28 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:15:28 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:15:28 user nova-compute[75293]:     </rng>
Nov 30 07:15:28 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:15:28 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:15:28 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:15:28 user nova-compute[75293]:     </memballoon>
Nov 30 07:15:28 user nova-compute[75293]:   </devices>
Nov 30 07:15:28 user nova-compute[75293]: </domain>
Nov 30 07:15:28 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-721563326',display_name='tempest-ServersNegativeTestJSON-server-721563326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-721563326',id=25,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8744f39a1f6d424fa13d77ed2ced51c5',ramdisk_id='',reservation_id='r-ww2rfr2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1767090220',owner_user_name='tempest-ServersNegativeTestJSON-1767090220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:15:26Z,user_data=None,user_id='f04441af417245e2a68e11d52ad7b05f',uuid=ed037c80-4f33-4e03-907c-18b4ea122411,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "address": "fa:16:3e:fe:7a:56", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap196acf39-31", "ovs_interfaceid": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Converting VIF {"id": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "address": "fa:16:3e:fe:7a:56", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap196acf39-31", "ovs_interfaceid": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:7a:56,bridge_name='br-int',has_traffic_filtering=True,id=196acf39-315e-4e6f-b324-b4e92ccdb6b8,network=Network(f557522c-aed7-4965-8036-cb4260a19168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap196acf39-31') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG os_vif [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:7a:56,bridge_name='br-int',has_traffic_filtering=True,id=196acf39-315e-4e6f-b324-b4e92ccdb6b8,network=Network(f557522c-aed7-4965-8036-cb4260a19168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap196acf39-31') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd058f53b-8e87-5da2-acf3-84113d8f0dff', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap196acf39-31, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap196acf39-31, col_values=(('qos', UUID('f287bd12-e5ec-4ff7-9032-45e3426819ae')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap196acf39-31, col_values=(('external_ids', {'iface-id': '196acf39-315e-4e6f-b324-b4e92ccdb6b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:7a:56', 'vm-uuid': 'ed037c80-4f33-4e03-907c-18b4ea122411'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:28 user nova-compute[75293]: INFO os_vif [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:7a:56,bridge_name='br-int',has_traffic_filtering=True,id=196acf39-315e-4e6f-b324-b4e92ccdb6b8,network=Network(f557522c-aed7-4965-8036-cb4260a19168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap196acf39-31')
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] No VIF found with MAC fa:16:3e:fe:7a:56, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.network.neutron [req-20936d24-52fa-4791-833d-e9ee3f7d6beb req-6545eeaf-0fc9-4c4a-b976-87620f43f979 service nova] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Updated VIF entry in instance network info cache for port 196acf39-315e-4e6f-b324-b4e92ccdb6b8. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.network.neutron [req-20936d24-52fa-4791-833d-e9ee3f7d6beb req-6545eeaf-0fc9-4c4a-b976-87620f43f979 service nova] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Updating instance_info_cache with network_info: [{"id": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "address": "fa:16:3e:fe:7a:56", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap196acf39-31", "ovs_interfaceid": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-20936d24-52fa-4791-833d-e9ee3f7d6beb req-6545eeaf-0fc9-4c4a-b976-87620f43f979 service nova] Releasing lock "refresh_cache-ed037c80-4f33-4e03-907c-18b4ea122411" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.680s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.compute.manager [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.compute.manager [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.network.neutron [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:15:28 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.compute.manager [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:15:28 user nova-compute[75293]: DEBUG nova.policy [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83119c1bbe4142a086680a113403018c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09e4044dadb4f2aa0d29f35f23008d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:15:28 user nova-compute[75293]: INFO nova.virt.block_device [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Booting with blank volume at /dev/vda
Nov 30 07:15:29 user nova-compute[75293]: DEBUG nova.network.neutron [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Successfully created port: 094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:15:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-57d36b8b-cdd6-4913-8299-d2b8a75ad2ce req-709ffbcd-0357-4085-ae42-8cabe15e68c2 service nova] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Received event network-vif-plugged-196acf39-315e-4e6f-b324-b4e92ccdb6b8 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:15:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-57d36b8b-cdd6-4913-8299-d2b8a75ad2ce req-709ffbcd-0357-4085-ae42-8cabe15e68c2 service nova] Acquiring lock "ed037c80-4f33-4e03-907c-18b4ea122411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-57d36b8b-cdd6-4913-8299-d2b8a75ad2ce req-709ffbcd-0357-4085-ae42-8cabe15e68c2 service nova] Lock "ed037c80-4f33-4e03-907c-18b4ea122411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-57d36b8b-cdd6-4913-8299-d2b8a75ad2ce req-709ffbcd-0357-4085-ae42-8cabe15e68c2 service nova] Lock "ed037c80-4f33-4e03-907c-18b4ea122411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-57d36b8b-cdd6-4913-8299-d2b8a75ad2ce req-709ffbcd-0357-4085-ae42-8cabe15e68c2 service nova] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] No waiting events found dispatching network-vif-plugged-196acf39-315e-4e6f-b324-b4e92ccdb6b8 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:15:30 user nova-compute[75293]: WARNING nova.compute.manager [req-57d36b8b-cdd6-4913-8299-d2b8a75ad2ce req-709ffbcd-0357-4085-ae42-8cabe15e68c2 service nova] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Received unexpected event network-vif-plugged-196acf39-315e-4e6f-b324-b4e92ccdb6b8 for instance with vm_state building and task_state spawning.
Nov 30 07:15:30 user nova-compute[75293]: DEBUG nova.network.neutron [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Successfully updated port: 094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:15:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "refresh_cache-9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:15:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquired lock "refresh_cache-9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:15:30 user nova-compute[75293]: DEBUG nova.network.neutron [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:15:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-c551efa4-7611-4bdc-9206-3af0b2ab3752 req-e3c253ab-4f7d-49bb-8d6b-2086019aa263 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received event network-changed-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:15:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-c551efa4-7611-4bdc-9206-3af0b2ab3752 req-e3c253ab-4f7d-49bb-8d6b-2086019aa263 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Refreshing instance network info cache due to event network-changed-094f0848-c129-4499-8781-6943982188b6. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:15:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c551efa4-7611-4bdc-9206-3af0b2ab3752 req-e3c253ab-4f7d-49bb-8d6b-2086019aa263 service nova] Acquiring lock "refresh_cache-9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:15:30 user nova-compute[75293]: DEBUG nova.network.neutron [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:15:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:31 user nova-compute[75293]: DEBUG nova.network.neutron [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Updating instance_info_cache with network_info: [{"id": "094f0848-c129-4499-8781-6943982188b6", "address": "fa:16:3e:44:2f:52", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094f0848-c1", "ovs_interfaceid": "094f0848-c129-4499-8781-6943982188b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:15:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Releasing lock "refresh_cache-9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:15:31 user nova-compute[75293]: DEBUG nova.compute.manager [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Instance network_info: |[{"id": "094f0848-c129-4499-8781-6943982188b6", "address": "fa:16:3e:44:2f:52", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094f0848-c1", "ovs_interfaceid": "094f0848-c129-4499-8781-6943982188b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:15:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c551efa4-7611-4bdc-9206-3af0b2ab3752 req-e3c253ab-4f7d-49bb-8d6b-2086019aa263 service nova] Acquired lock "refresh_cache-9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:15:31 user nova-compute[75293]: DEBUG nova.network.neutron [req-c551efa4-7611-4bdc-9206-3af0b2ab3752 req-e3c253ab-4f7d-49bb-8d6b-2086019aa263 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Refreshing network info cache for port 094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:15:31 user nova-compute[75293]: DEBUG nova.network.neutron [req-c551efa4-7611-4bdc-9206-3af0b2ab3752 req-e3c253ab-4f7d-49bb-8d6b-2086019aa263 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Updated VIF entry in instance network info cache for port 094f0848-c129-4499-8781-6943982188b6. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:15:31 user nova-compute[75293]: DEBUG nova.network.neutron [req-c551efa4-7611-4bdc-9206-3af0b2ab3752 req-e3c253ab-4f7d-49bb-8d6b-2086019aa263 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Updating instance_info_cache with network_info: [{"id": "094f0848-c129-4499-8781-6943982188b6", "address": "fa:16:3e:44:2f:52", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094f0848-c1", "ovs_interfaceid": "094f0848-c129-4499-8781-6943982188b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:15:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c551efa4-7611-4bdc-9206-3af0b2ab3752 req-e3c253ab-4f7d-49bb-8d6b-2086019aa263 service nova] Releasing lock "refresh_cache-9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:15:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-ee996896-deb1-48f0-9afd-38c71ec060b7 req-098efd86-06f0-4de4-ab3b-c410561ebccc service nova] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Received event network-vif-plugged-196acf39-315e-4e6f-b324-b4e92ccdb6b8 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:15:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ee996896-deb1-48f0-9afd-38c71ec060b7 req-098efd86-06f0-4de4-ab3b-c410561ebccc service nova] Acquiring lock "ed037c80-4f33-4e03-907c-18b4ea122411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ee996896-deb1-48f0-9afd-38c71ec060b7 req-098efd86-06f0-4de4-ab3b-c410561ebccc service nova] Lock "ed037c80-4f33-4e03-907c-18b4ea122411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ee996896-deb1-48f0-9afd-38c71ec060b7 req-098efd86-06f0-4de4-ab3b-c410561ebccc service nova] Lock "ed037c80-4f33-4e03-907c-18b4ea122411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-ee996896-deb1-48f0-9afd-38c71ec060b7 req-098efd86-06f0-4de4-ab3b-c410561ebccc service nova] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] No waiting events found dispatching network-vif-plugged-196acf39-315e-4e6f-b324-b4e92ccdb6b8 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:15:32 user nova-compute[75293]: WARNING nova.compute.manager [req-ee996896-deb1-48f0-9afd-38c71ec060b7 req-098efd86-06f0-4de4-ab3b-c410561ebccc service nova] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Received unexpected event network-vif-plugged-196acf39-315e-4e6f-b324-b4e92ccdb6b8 for instance with vm_state building and task_state spawning.
Nov 30 07:15:32 user nova-compute[75293]: DEBUG nova.compute.manager [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:15:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:15:32 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Instance spawned successfully.
Nov 30 07:15:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:15:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:33 user nova-compute[75293]: INFO nova.compute.manager [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Took 7.02 seconds to spawn the instance on the hypervisor.
Nov 30 07:15:33 user nova-compute[75293]: DEBUG nova.compute.manager [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:15:33 user nova-compute[75293]: INFO nova.compute.manager [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Took 7.96 seconds to build instance.
Nov 30 07:15:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-76969fce-f7f8-4d37-b302-2df8dce5e2ec tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "ed037c80-4f33-4e03-907c-18b4ea122411" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.060s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG os_brick.utils [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1313c7b0-b2b2-470e-88b1-9534d91d6c70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef867b6a-1a4e-4858-920f-61e3c086581d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2612ba4e-b40f-4d5f-91fd-958e4b5d5ad4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8604e706-b412-4322-91c0-b999026ea06c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:15:34 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:15:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b596e0-46b6-4075-b7d6-3d945cf19de5]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG os_brick.utils [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:15:34 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Updating existing volume attachment record: 06f81404-d868-4073-87b0-e31c00210633 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:15:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.compute.manager [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:15:43 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Creating image(s)
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Did not create local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Ensure instance console log exists: /opt/stack/data/nova/instances/9b9424a3-3053-4b8f-9eb9-5c81944a8fd5/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Start _get_guest_xml network_info=[{"id": "094f0848-c129-4499-8781-6943982188b6", "address": "fa:16:3e:44:2f:52", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094f0848-c1", "ovs_interfaceid": "094f0848-c129-4499-8781-6943982188b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlBbPIwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9b9424a3-3053-4b8f-9eb9-5c81944a8fd5', 'attached_at': '', 'detached_at': '', 'volume_id': 'd2b68185-3fc6-4d60-b764-b8c4cb3ce54d', 'serial': 'd2b68185-3fc6-4d60-b764-b8c4cb3ce54d'}, 'delete_on_termination': False, 'attachment_id': '06f81404-d868-4073-87b0-e31c00210633', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:15:43 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:15:43 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlBbPIwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:15:43 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:15:43 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:15:43 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83a7be2-cd55-4eea-ac3f-b74cd9357152]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:15:43 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c582d30-de2a-48ab-b113-6f84ac9874cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d] added
Nov 30 07:15:43 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3017eca9-d176-43d0-b941-986540c06bf9]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d4d0b9-61ae-47d2-9835-953a747f7cf4]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tlBbPIwT {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tlBbPIwT" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce392a5-45b1-4d54-8a36-4111173baa0c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tlBbPIwT'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[57afdbeb-4fd4-4f8e-b70b-c7e390d36e30]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f30184a-2b3c-4072-8fa4-4dc86ab29854]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:15:43 user nova-compute[75293]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:15:43 user nova-compute[75293]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:15:43 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:15:43 user nova-compute[75293]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:15:43 user nova-compute[75293]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:15:43 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e8c3ca-b48e-4890-a835-5495c3675728]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d, portal: 172.16.0.220,3260]
Nov 30 07:15:43 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d, portal: 172.16.0.220,3260] successful.
Nov 30 07:15:43 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afe19d0-add3-43e5-80ab-2ea7beba54f8]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd70a69-764d-47b6-acda-acf30ffd4a06]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:15:43 user nova-compute[75293]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:15:43 user nova-compute[75293]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:15:43 user nova-compute[75293]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:15:43 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:15:43 user nova-compute[75293]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:15:43 user nova-compute[75293]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:15:43 user nova-compute[75293]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:15:43 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f93e57e-efd9-4cdd-960c-dbb99e81f246]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:15:43 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlBbPIwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:15:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:15:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26136663537323537', 'path': '/dev/sdd'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:15:44 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136663537323537', 'path': '/dev/sdd'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:15:44 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:15:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-542946188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-542946188',id=26,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09e4044dadb4f2aa0d29f35f23008d2',ramdisk_id='',reservation_id='r-wj45bcq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:15:29Z,user_data=None,user_id='83119c1bbe4142a086680a113403018c',uuid=9b9424a3-3053-4b8f-9eb9-5c81944a8fd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "094f0848-c129-4499-8781-6943982188b6", "address": "fa:16:3e:44:2f:52", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094f0848-c1", "ovs_interfaceid": "094f0848-c129-4499-8781-6943982188b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:15:44 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converting VIF {"id": "094f0848-c129-4499-8781-6943982188b6", "address": "fa:16:3e:44:2f:52", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094f0848-c1", "ovs_interfaceid": "094f0848-c129-4499-8781-6943982188b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:15:44 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:2f:52,bridge_name='br-int',has_traffic_filtering=True,id=094f0848-c129-4499-8781-6943982188b6,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094f0848-c1') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:15:44 user nova-compute[75293]: DEBUG nova.objects.instance [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:15:45 user nova-compute[75293]:   <uuid>9b9424a3-3053-4b8f-9eb9-5c81944a8fd5</uuid>
Nov 30 07:15:45 user nova-compute[75293]:   <name>instance-0000001a</name>
Nov 30 07:15:45 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:15:45 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:15:45 user nova-compute[75293]:   <metadata>
Nov 30 07:15:45 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:15:45 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:15:45 user nova-compute[75293]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-542946188</nova:name>
Nov 30 07:15:45 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:15:43</nova:creationTime>
Nov 30 07:15:45 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:15:45 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:15:45 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:15:45 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:15:45 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:15:45 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:15:45 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:15:45 user nova-compute[75293]:       <nova:owner>
Nov 30 07:15:45 user nova-compute[75293]:         <nova:user uuid="83119c1bbe4142a086680a113403018c">tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member</nova:user>
Nov 30 07:15:45 user nova-compute[75293]:         <nova:project uuid="f09e4044dadb4f2aa0d29f35f23008d2">tempest-ServerBootFromVolumeStableRescueTest-2053873633</nova:project>
Nov 30 07:15:45 user nova-compute[75293]:       </nova:owner>
Nov 30 07:15:45 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:15:45 user nova-compute[75293]:       <nova:ports>
Nov 30 07:15:45 user nova-compute[75293]:         <nova:port uuid="094f0848-c129-4499-8781-6943982188b6">
Nov 30 07:15:45 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 07:15:45 user nova-compute[75293]:         </nova:port>
Nov 30 07:15:45 user nova-compute[75293]:       </nova:ports>
Nov 30 07:15:45 user nova-compute[75293]:     </nova:instance>
Nov 30 07:15:45 user nova-compute[75293]:   </metadata>
Nov 30 07:15:45 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:15:45 user nova-compute[75293]:     <system>
Nov 30 07:15:45 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:15:45 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:15:45 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:15:45 user nova-compute[75293]:       <entry name="serial">9b9424a3-3053-4b8f-9eb9-5c81944a8fd5</entry>
Nov 30 07:15:45 user nova-compute[75293]:       <entry name="uuid">9b9424a3-3053-4b8f-9eb9-5c81944a8fd5</entry>
Nov 30 07:15:45 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:15:45 user nova-compute[75293]:     </system>
Nov 30 07:15:45 user nova-compute[75293]:   </sysinfo>
Nov 30 07:15:45 user nova-compute[75293]:   <os>
Nov 30 07:15:45 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:15:45 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:15:45 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:15:45 user nova-compute[75293]:   </os>
Nov 30 07:15:45 user nova-compute[75293]:   <features>
Nov 30 07:15:45 user nova-compute[75293]:     <acpi/>
Nov 30 07:15:45 user nova-compute[75293]:     <apic/>
Nov 30 07:15:45 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:15:45 user nova-compute[75293]:   </features>
Nov 30 07:15:45 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:15:45 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:15:45 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:15:45 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:15:45 user nova-compute[75293]:   </clock>
Nov 30 07:15:45 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:15:45 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:15:45 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:15:45 user nova-compute[75293]:   </cpu>
Nov 30 07:15:45 user nova-compute[75293]:   <devices>
Nov 30 07:15:45 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:15:45 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:15:45 user nova-compute[75293]:       <source dev="/dev/sdd"/>
Nov 30 07:15:45 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:15:45 user nova-compute[75293]:       <serial>d2b68185-3fc6-4d60-b764-b8c4cb3ce54d</serial>
Nov 30 07:15:45 user nova-compute[75293]:     </disk>
Nov 30 07:15:45 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:15:45 user nova-compute[75293]:       <mac address="fa:16:3e:44:2f:52"/>
Nov 30 07:15:45 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:15:45 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:15:45 user nova-compute[75293]:       <target dev="tap094f0848-c1"/>
Nov 30 07:15:45 user nova-compute[75293]:     </interface>
Nov 30 07:15:45 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:15:45 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/9b9424a3-3053-4b8f-9eb9-5c81944a8fd5/console.log" append="off"/>
Nov 30 07:15:45 user nova-compute[75293]:     </serial>
Nov 30 07:15:45 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:15:45 user nova-compute[75293]:     <video>
Nov 30 07:15:45 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:15:45 user nova-compute[75293]:     </video>
Nov 30 07:15:45 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:15:45 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:15:45 user nova-compute[75293]:     </rng>
Nov 30 07:15:45 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:15:45 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:15:45 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:15:45 user nova-compute[75293]:     </memballoon>
Nov 30 07:15:45 user nova-compute[75293]:   </devices>
Nov 30 07:15:45 user nova-compute[75293]: </domain>
Nov 30 07:15:45 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:15:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-542946188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-542946188',id=26,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09e4044dadb4f2aa0d29f35f23008d2',ramdisk_id='',reservation_id='r-wj45bcq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:15:29Z,user_data=None,user_id='83119c1bbe4142a086680a113403018c',uuid=9b9424a3-3053-4b8f-9eb9-5c81944a8fd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "094f0848-c129-4499-8781-6943982188b6", "address": "fa:16:3e:44:2f:52", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094f0848-c1", "ovs_interfaceid": "094f0848-c129-4499-8781-6943982188b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converting VIF {"id": "094f0848-c129-4499-8781-6943982188b6", "address": "fa:16:3e:44:2f:52", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094f0848-c1", "ovs_interfaceid": "094f0848-c129-4499-8781-6943982188b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:2f:52,bridge_name='br-int',has_traffic_filtering=True,id=094f0848-c129-4499-8781-6943982188b6,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094f0848-c1') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG os_vif [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:2f:52,bridge_name='br-int',has_traffic_filtering=True,id=094f0848-c129-4499-8781-6943982188b6,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094f0848-c1') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfb1614e-e143-5229-aca5-281c60cad97d', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap094f0848-c1, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap094f0848-c1, col_values=(('qos', UUID('11945ddb-1ee6-47ce-9ce5-6765c434de70')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap094f0848-c1, col_values=(('external_ids', {'iface-id': '094f0848-c129-4499-8781-6943982188b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:2f:52', 'vm-uuid': '9b9424a3-3053-4b8f-9eb9-5c81944a8fd5'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:45 user nova-compute[75293]: INFO os_vif [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:2f:52,bridge_name='br-int',has_traffic_filtering=True,id=094f0848-c129-4499-8781-6943982188b6,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094f0848-c1')
Nov 30 07:15:45 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:15:45 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] No VIF found with MAC fa:16:3e:44:2f:52, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:15:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:46 user nova-compute[75293]: DEBUG nova.compute.manager [req-62e3d9b9-03a6-4260-9c7e-f8a3b982c66e req-969f2f2d-4d1c-4daa-aebd-d4c11ec4772d service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received event network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:15:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-62e3d9b9-03a6-4260-9c7e-f8a3b982c66e req-969f2f2d-4d1c-4daa-aebd-d4c11ec4772d service nova] Acquiring lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-62e3d9b9-03a6-4260-9c7e-f8a3b982c66e req-969f2f2d-4d1c-4daa-aebd-d4c11ec4772d service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-62e3d9b9-03a6-4260-9c7e-f8a3b982c66e req-969f2f2d-4d1c-4daa-aebd-d4c11ec4772d service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:46 user nova-compute[75293]: DEBUG nova.compute.manager [req-62e3d9b9-03a6-4260-9c7e-f8a3b982c66e req-969f2f2d-4d1c-4daa-aebd-d4c11ec4772d service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] No waiting events found dispatching network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:15:46 user nova-compute[75293]: WARNING nova.compute.manager [req-62e3d9b9-03a6-4260-9c7e-f8a3b982c66e req-969f2f2d-4d1c-4daa-aebd-d4c11ec4772d service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received unexpected event network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 for instance with vm_state building and task_state spawning.
Nov 30 07:15:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "009f70bc-7561-48fe-ba47-ebaf4d81d462" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:48 user nova-compute[75293]: INFO nova.compute.manager [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Detaching volume c9bf2351-4111-4c11-b609-97a218ac8ba5
Nov 30 07:15:48 user nova-compute[75293]: INFO nova.virt.block_device [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Attempting to driver detach volume c9bf2351-4111-4c11-b609-97a218ac8ba5 from mountpoint /dev/vdb
Nov 30 07:15:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Attempting to detach device vdb from instance 009f70bc-7561-48fe-ba47-ebaf4d81d462 from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:15:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:15:48 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:15:48 user nova-compute[75293]:   <source dev="/dev/sde"/>
Nov 30 07:15:48 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:15:48 user nova-compute[75293]:   <serial>c9bf2351-4111-4c11-b609-97a218ac8ba5</serial>
Nov 30 07:15:48 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 07:15:48 user nova-compute[75293]: </disk>
Nov 30 07:15:48 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:15:48 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Successfully detached device vdb from instance 009f70bc-7561-48fe-ba47-ebaf4d81d462 from the persistent domain config.
Nov 30 07:15:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 009f70bc-7561-48fe-ba47-ebaf4d81d462 from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:15:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:15:48 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:15:48 user nova-compute[75293]:   <source dev="/dev/sde"/>
Nov 30 07:15:48 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:15:48 user nova-compute[75293]:   <serial>c9bf2351-4111-4c11-b609-97a218ac8ba5</serial>
Nov 30 07:15:48 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 30 07:15:48 user nova-compute[75293]: </disk>
Nov 30 07:15:48 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:15:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 009f70bc-7561-48fe-ba47-ebaf4d81d462 {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:15:48 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:15:48 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:15:48 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:15:48 user nova-compute[75293]: DEBUG nova.compute.manager [req-4c3d2cf6-05b3-4176-9b43-65e43e1be4cc req-48b0b31c-fe0f-4bfd-886b-f7796bf4709b service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received event network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:15:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4c3d2cf6-05b3-4176-9b43-65e43e1be4cc req-48b0b31c-fe0f-4bfd-886b-f7796bf4709b service nova] Acquiring lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4c3d2cf6-05b3-4176-9b43-65e43e1be4cc req-48b0b31c-fe0f-4bfd-886b-f7796bf4709b service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4c3d2cf6-05b3-4176-9b43-65e43e1be4cc req-48b0b31c-fe0f-4bfd-886b-f7796bf4709b service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:48 user nova-compute[75293]: DEBUG nova.compute.manager [req-4c3d2cf6-05b3-4176-9b43-65e43e1be4cc req-48b0b31c-fe0f-4bfd-886b-f7796bf4709b service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] No waiting events found dispatching network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:15:48 user nova-compute[75293]: WARNING nova.compute.manager [req-4c3d2cf6-05b3-4176-9b43-65e43e1be4cc req-48b0b31c-fe0f-4bfd-886b-f7796bf4709b service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received unexpected event network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 for instance with vm_state building and task_state spawning.
Nov 30 07:15:49 user nova-compute[75293]: DEBUG nova.compute.manager [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:15:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:15:49 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Instance spawned successfully.
Nov 30 07:15:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:15:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:15:49 user nova-compute[75293]: INFO nova.compute.manager [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Took 5.93 seconds to spawn the instance on the hypervisor.
Nov 30 07:15:49 user nova-compute[75293]: DEBUG nova.compute.manager [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:15:49 user nova-compute[75293]: INFO nova.compute.manager [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Took 21.76 seconds to build instance.
Nov 30 07:15:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1a22693f-6734-4376-b68a-ad56e9be49b8 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.878s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:51 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:15:51 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:15:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-c8d1df78-2aa2-4710-a570-5f72c60cfc26" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:15:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-c8d1df78-2aa2-4710-a570-5f72c60cfc26" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:15:51 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:15:52 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Updating instance_info_cache with network_info: [{"id": "66299713-0237-47db-9fef-e5816beed9d9", "address": "fa:16:3e:db:c2:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66299713-02", "ovs_interfaceid": "66299713-0237-47db-9fef-e5816beed9d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:15:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-c8d1df78-2aa2-4710-a570-5f72c60cfc26" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:15:52 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:15:52 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:15:52 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:15:52 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:15:52 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:15:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:52 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:15:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:15:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:15:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:15:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:15:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:15:57 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:15:57 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:15:57 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=7110MB free_disk=25.176612854003906GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b7deb0a-39af-4d93-b93d-5765a731f702 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 009f70bc-7561-48fe-ba47-ebaf4d81d462 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance c8d1df78-2aa2-4710-a570-5f72c60cfc26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9295d423-d71c-436b-9306-e0b386a0011f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 677602ec-88fd-4026-8112-8469855f8a78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 39042069-ac9b-4b13-b486-c845e84ac041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance d34f99fc-343e-4e8a-83e6-372b0326bded actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 093deaa6-a68c-4688-9055-69dda63b6b4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 4be43bb1-b17c-40b9-953a-c820f2396176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 5576f436-247d-461d-9859-f9bb3ee4fa18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance ed037c80-4f33-4e03-907c-18b4ea122411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:15:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.595s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:15:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:15:58 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:15:58 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:16:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "9295d423-d71c-436b-9306-e0b386a0011f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "9295d423-d71c-436b-9306-e0b386a0011f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG nova.objects.instance [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lazy-loading 'flavor' on Instance uuid 9295d423-d71c-436b-9306-e0b386a0011f {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "9295d423-d71c-436b-9306-e0b386a0011f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "9295d423-d71c-436b-9306-e0b386a0011f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "9295d423-d71c-436b-9306-e0b386a0011f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:01 user nova-compute[75293]: INFO nova.compute.manager [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Attaching volume a9d31834-8af6-4f2b-b597-74b774d2e19c to /dev/vdb
Nov 30 07:16:01 user nova-compute[75293]: DEBUG os_brick.utils [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[207206f4-5a88-46c5-a219-b3cb57fb12f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[45399555-82ea-4a72-8edc-b82ff91fc772]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4d3381-410e-4f8e-ad44-ddbf930bd344]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d41df1-d718-4d17-bcff-0dde76c32e4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:16:01 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:16:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[16110b44-f215-443e-84b3-e1c057285f74]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG os_brick.utils [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:16:01 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Updating existing volume attachment record: c7ed7b43-53fe-4a76-9817-fcb5cb6543c8 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:16:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:04 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:16:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:16:04 user nova-compute[75293]: INFO nova.compute.claims [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Claim successful on node user
Nov 30 07:16:04 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:16:04 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:16:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:04 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:05 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:16:05 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG nova.policy [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e489f4b647647a7920d2389a7ea3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2bfbd8ed6e440cae055aa384db6ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:16:05 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Creating image(s)
Nov 30 07:16:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "/opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "/opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "/opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.211s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.176s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk 1073741824" returned: 0 in 0.049s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.198s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:16:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Cannot resize image /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Ensure instance console log exists: /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Successfully created port: cbfcdcde-3eb5-4718-9e72-f0bc28211827 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-51598151-bd79-4350-ab96-20d62d186dc8 req-3e903f00-def2-47ed-87a0-9f57b361b414 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received event network-changed-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-51598151-bd79-4350-ab96-20d62d186dc8 req-3e903f00-def2-47ed-87a0-9f57b361b414 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Refreshing instance network info cache due to event network-changed-814f9aa9-6974-4b76-96ba-52668f19b3f1. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-51598151-bd79-4350-ab96-20d62d186dc8 req-3e903f00-def2-47ed-87a0-9f57b361b414 service nova] Acquiring lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-51598151-bd79-4350-ab96-20d62d186dc8 req-3e903f00-def2-47ed-87a0-9f57b361b414 service nova] Acquired lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG nova.network.neutron [req-51598151-bd79-4350-ab96-20d62d186dc8 req-3e903f00-def2-47ed-87a0-9f57b361b414 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Refreshing network info cache for port 814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Successfully updated port: cbfcdcde-3eb5-4718-9e72-f0bc28211827 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "refresh_cache-a46f0c4f-4449-47e2-aa1e-a4508c81d768" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquired lock "refresh_cache-a46f0c4f-4449-47e2-aa1e-a4508c81d768" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-cde2201a-2bb1-41a9-bad6-b21ce12d0e59 req-ce272fe3-207c-48b7-a8b4-fe4fcff87134 service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Received event network-changed-cbfcdcde-3eb5-4718-9e72-f0bc28211827 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-cde2201a-2bb1-41a9-bad6-b21ce12d0e59 req-ce272fe3-207c-48b7-a8b4-fe4fcff87134 service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Refreshing instance network info cache due to event network-changed-cbfcdcde-3eb5-4718-9e72-f0bc28211827. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cde2201a-2bb1-41a9-bad6-b21ce12d0e59 req-ce272fe3-207c-48b7-a8b4-fe4fcff87134 service nova] Acquiring lock "refresh_cache-a46f0c4f-4449-47e2-aa1e-a4508c81d768" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:16:06 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Updating instance_info_cache with network_info: [{"id": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "address": "fa:16:3e:57:b9:0d", "network": {"id": "a1600e76-0910-4c90-8474-0f0152873c7e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1517603206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2bfbd8ed6e440cae055aa384db6ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfcdcde-3e", "ovs_interfaceid": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Releasing lock "refresh_cache-a46f0c4f-4449-47e2-aa1e-a4508c81d768" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Instance network_info: |[{"id": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "address": "fa:16:3e:57:b9:0d", "network": {"id": "a1600e76-0910-4c90-8474-0f0152873c7e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1517603206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2bfbd8ed6e440cae055aa384db6ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfcdcde-3e", "ovs_interfaceid": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cde2201a-2bb1-41a9-bad6-b21ce12d0e59 req-ce272fe3-207c-48b7-a8b4-fe4fcff87134 service nova] Acquired lock "refresh_cache-a46f0c4f-4449-47e2-aa1e-a4508c81d768" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.network.neutron [req-cde2201a-2bb1-41a9-bad6-b21ce12d0e59 req-ce272fe3-207c-48b7-a8b4-fe4fcff87134 service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Refreshing network info cache for port cbfcdcde-3eb5-4718-9e72-f0bc28211827 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Start _get_guest_xml network_info=[{"id": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "address": "fa:16:3e:57:b9:0d", "network": {"id": "a1600e76-0910-4c90-8474-0f0152873c7e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1517603206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2bfbd8ed6e440cae055aa384db6ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfcdcde-3e", "ovs_interfaceid": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:16:07 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:16:07 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:16:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1952813352',display_name='tempest-TestServerVolumeAttachmentScenario-server-1952813352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1952813352',id=27,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza/CpmCdEeihVeNtrVo4urRHcv8jPCLi0kKb8EG/2IVYf9BnUDzgL1h3IJ5jIDgIzCbfzdSfFFzjLw0ZftKfXaZOzDdkaLtbrJyvnpX4MRuXtvaDW/X079lBbxDaD0WQ==',key_name='tempest-keypair-2053072957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c2bfbd8ed6e440cae055aa384db6ae5',ramdisk_id='',reservation_id='r-jh5cmiab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-145588257',owner_user_name='tempest-TestServerVolumeAttachmentScenario-145588257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:16:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e489f4b647647a7920d2389a7ea3e1d',uuid=a46f0c4f-4449-47e2-aa1e-a4508c81d768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "address": "fa:16:3e:57:b9:0d", "network": {"id": "a1600e76-0910-4c90-8474-0f0152873c7e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1517603206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2bfbd8ed6e440cae055aa384db6ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfcdcde-3e", "ovs_interfaceid": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Converting VIF {"id": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "address": "fa:16:3e:57:b9:0d", "network": {"id": "a1600e76-0910-4c90-8474-0f0152873c7e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1517603206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2bfbd8ed6e440cae055aa384db6ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfcdcde-3e", "ovs_interfaceid": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=cbfcdcde-3eb5-4718-9e72-f0bc28211827,network=Network(a1600e76-0910-4c90-8474-0f0152873c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbfcdcde-3e') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.objects.instance [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lazy-loading 'pci_devices' on Instance uuid a46f0c4f-4449-47e2-aa1e-a4508c81d768 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.network.neutron [req-51598151-bd79-4350-ab96-20d62d186dc8 req-3e903f00-def2-47ed-87a0-9f57b361b414 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Updated VIF entry in instance network info cache for port 814f9aa9-6974-4b76-96ba-52668f19b3f1. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.network.neutron [req-51598151-bd79-4350-ab96-20d62d186dc8 req-3e903f00-def2-47ed-87a0-9f57b361b414 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Updating instance_info_cache with network_info: [{"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:16:07 user nova-compute[75293]:   <uuid>a46f0c4f-4449-47e2-aa1e-a4508c81d768</uuid>
Nov 30 07:16:07 user nova-compute[75293]:   <name>instance-0000001b</name>
Nov 30 07:16:07 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:16:07 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:16:07 user nova-compute[75293]:   <metadata>
Nov 30 07:16:07 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:16:07 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:16:07 user nova-compute[75293]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1952813352</nova:name>
Nov 30 07:16:07 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:16:07</nova:creationTime>
Nov 30 07:16:07 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:16:07 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:16:07 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:16:07 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:16:07 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:16:07 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:16:07 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:16:07 user nova-compute[75293]:       <nova:owner>
Nov 30 07:16:07 user nova-compute[75293]:         <nova:user uuid="9e489f4b647647a7920d2389a7ea3e1d">tempest-TestServerVolumeAttachmentScenario-145588257-project-member</nova:user>
Nov 30 07:16:07 user nova-compute[75293]:         <nova:project uuid="5c2bfbd8ed6e440cae055aa384db6ae5">tempest-TestServerVolumeAttachmentScenario-145588257</nova:project>
Nov 30 07:16:07 user nova-compute[75293]:       </nova:owner>
Nov 30 07:16:07 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:16:07 user nova-compute[75293]:       <nova:ports>
Nov 30 07:16:07 user nova-compute[75293]:         <nova:port uuid="cbfcdcde-3eb5-4718-9e72-f0bc28211827">
Nov 30 07:16:07 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 07:16:07 user nova-compute[75293]:         </nova:port>
Nov 30 07:16:07 user nova-compute[75293]:       </nova:ports>
Nov 30 07:16:07 user nova-compute[75293]:     </nova:instance>
Nov 30 07:16:07 user nova-compute[75293]:   </metadata>
Nov 30 07:16:07 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:16:07 user nova-compute[75293]:     <system>
Nov 30 07:16:07 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:16:07 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:16:07 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:16:07 user nova-compute[75293]:       <entry name="serial">a46f0c4f-4449-47e2-aa1e-a4508c81d768</entry>
Nov 30 07:16:07 user nova-compute[75293]:       <entry name="uuid">a46f0c4f-4449-47e2-aa1e-a4508c81d768</entry>
Nov 30 07:16:07 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:16:07 user nova-compute[75293]:     </system>
Nov 30 07:16:07 user nova-compute[75293]:   </sysinfo>
Nov 30 07:16:07 user nova-compute[75293]:   <os>
Nov 30 07:16:07 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:16:07 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:16:07 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:16:07 user nova-compute[75293]:   </os>
Nov 30 07:16:07 user nova-compute[75293]:   <features>
Nov 30 07:16:07 user nova-compute[75293]:     <acpi/>
Nov 30 07:16:07 user nova-compute[75293]:     <apic/>
Nov 30 07:16:07 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:16:07 user nova-compute[75293]:   </features>
Nov 30 07:16:07 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:16:07 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:16:07 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:16:07 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:16:07 user nova-compute[75293]:   </clock>
Nov 30 07:16:07 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:16:07 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:16:07 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:16:07 user nova-compute[75293]:   </cpu>
Nov 30 07:16:07 user nova-compute[75293]:   <devices>
Nov 30 07:16:07 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:16:07 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:16:07 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk"/>
Nov 30 07:16:07 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:16:07 user nova-compute[75293]:     </disk>
Nov 30 07:16:07 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:16:07 user nova-compute[75293]:       <mac address="fa:16:3e:57:b9:0d"/>
Nov 30 07:16:07 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:16:07 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:16:07 user nova-compute[75293]:       <target dev="tapcbfcdcde-3e"/>
Nov 30 07:16:07 user nova-compute[75293]:     </interface>
Nov 30 07:16:07 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:16:07 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/console.log" append="off"/>
Nov 30 07:16:07 user nova-compute[75293]:     </serial>
Nov 30 07:16:07 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:16:07 user nova-compute[75293]:     <video>
Nov 30 07:16:07 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:16:07 user nova-compute[75293]:     </video>
Nov 30 07:16:07 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:16:07 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:16:07 user nova-compute[75293]:     </rng>
Nov 30 07:16:07 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:16:07 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:16:07 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:16:07 user nova-compute[75293]:     </memballoon>
Nov 30 07:16:07 user nova-compute[75293]:   </devices>
Nov 30 07:16:07 user nova-compute[75293]: </domain>
Nov 30 07:16:07 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:16:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1952813352',display_name='tempest-TestServerVolumeAttachmentScenario-server-1952813352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1952813352',id=27,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza/CpmCdEeihVeNtrVo4urRHcv8jPCLi0kKb8EG/2IVYf9BnUDzgL1h3IJ5jIDgIzCbfzdSfFFzjLw0ZftKfXaZOzDdkaLtbrJyvnpX4MRuXtvaDW/X079lBbxDaD0WQ==',key_name='tempest-keypair-2053072957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c2bfbd8ed6e440cae055aa384db6ae5',ramdisk_id='',reservation_id='r-jh5cmiab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-145588257',owner_user_name='tempest-TestServerVolumeAttachmentScenario-145588257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:16:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e489f4b647647a7920d2389a7ea3e1d',uuid=a46f0c4f-4449-47e2-aa1e-a4508c81d768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "address": "fa:16:3e:57:b9:0d", "network": {"id": "a1600e76-0910-4c90-8474-0f0152873c7e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1517603206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2bfbd8ed6e440cae055aa384db6ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfcdcde-3e", "ovs_interfaceid": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Converting VIF {"id": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "address": "fa:16:3e:57:b9:0d", "network": {"id": "a1600e76-0910-4c90-8474-0f0152873c7e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1517603206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2bfbd8ed6e440cae055aa384db6ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfcdcde-3e", "ovs_interfaceid": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=cbfcdcde-3eb5-4718-9e72-f0bc28211827,network=Network(a1600e76-0910-4c90-8474-0f0152873c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbfcdcde-3e') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG os_vif [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=cbfcdcde-3eb5-4718-9e72-f0bc28211827,network=Network(a1600e76-0910-4c90-8474-0f0152873c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbfcdcde-3e') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-51598151-bd79-4350-ab96-20d62d186dc8 req-3e903f00-def2-47ed-87a0-9f57b361b414 service nova] Releasing lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0155ae3e-f7bd-52bc-96ae-855ac8aefd87', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbfcdcde-3e, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcbfcdcde-3e, col_values=(('qos', UUID('e254fdc3-abcd-4cc2-b86e-af6365b00bba')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcbfcdcde-3e, col_values=(('external_ids', {'iface-id': 'cbfcdcde-3eb5-4718-9e72-f0bc28211827', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:b9:0d', 'vm-uuid': 'a46f0c4f-4449-47e2-aa1e-a4508c81d768'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:07 user nova-compute[75293]: INFO os_vif [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=cbfcdcde-3eb5-4718-9e72-f0bc28211827,network=Network(a1600e76-0910-4c90-8474-0f0152873c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbfcdcde-3e')
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] No VIF found with MAC fa:16:3e:57:b9:0d, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "677602ec-88fd-4026-8112-8469855f8a78" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "677602ec-88fd-4026-8112-8469855f8a78" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:07 user nova-compute[75293]: INFO nova.compute.manager [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Shelve offloading
Nov 30 07:16:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.network.neutron [req-cde2201a-2bb1-41a9-bad6-b21ce12d0e59 req-ce272fe3-207c-48b7-a8b4-fe4fcff87134 service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Updated VIF entry in instance network info cache for port cbfcdcde-3eb5-4718-9e72-f0bc28211827. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG nova.network.neutron [req-cde2201a-2bb1-41a9-bad6-b21ce12d0e59 req-ce272fe3-207c-48b7-a8b4-fe4fcff87134 service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Updating instance_info_cache with network_info: [{"id": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "address": "fa:16:3e:57:b9:0d", "network": {"id": "a1600e76-0910-4c90-8474-0f0152873c7e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1517603206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2bfbd8ed6e440cae055aa384db6ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfcdcde-3e", "ovs_interfaceid": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:16:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cde2201a-2bb1-41a9-bad6-b21ce12d0e59 req-ce272fe3-207c-48b7-a8b4-fe4fcff87134 service nova] Releasing lock "refresh_cache-a46f0c4f-4449-47e2-aa1e-a4508c81d768" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-24141578-8739-4936-93b8-e379c7024972 req-0e17be27-511e-4a3f-97c5-c46aecf11d39 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received event network-vif-unplugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-24141578-8739-4936-93b8-e379c7024972 req-0e17be27-511e-4a3f-97c5-c46aecf11d39 service nova] Acquiring lock "677602ec-88fd-4026-8112-8469855f8a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-24141578-8739-4936-93b8-e379c7024972 req-0e17be27-511e-4a3f-97c5-c46aecf11d39 service nova] Lock "677602ec-88fd-4026-8112-8469855f8a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-24141578-8739-4936-93b8-e379c7024972 req-0e17be27-511e-4a3f-97c5-c46aecf11d39 service nova] Lock "677602ec-88fd-4026-8112-8469855f8a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-24141578-8739-4936-93b8-e379c7024972 req-0e17be27-511e-4a3f-97c5-c46aecf11d39 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] No waiting events found dispatching network-vif-unplugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:08 user nova-compute[75293]: WARNING nova.compute.manager [req-24141578-8739-4936-93b8-e379c7024972 req-0e17be27-511e-4a3f-97c5-c46aecf11d39 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received unexpected event network-vif-unplugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 for instance with vm_state active and task_state shelving.
Nov 30 07:16:08 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Instance destroyed successfully.
Nov 30 07:16:08 user nova-compute[75293]: DEBUG nova.compute.manager [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquired lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:16:08 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 009f70bc-7561-48fe-ba47-ebaf4d81d462 is timed out.
Nov 30 07:16:08 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Successfully detached device vdb from instance 009f70bc-7561-48fe-ba47-ebaf4d81d462 from the live domain config.
Nov 30 07:16:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZwMXcjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:16:08 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:16:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e052e4-3681-4d90-9853-7b6a9fbc8f8e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:16:08 user nova-compute[75293]: No targets found.
Nov 30 07:16:08 user nova-compute[75293]: iSNS:
Nov 30 07:16:08 user nova-compute[75293]: No targets found.
Nov 30 07:16:08 user nova-compute[75293]: STATIC:
Nov 30 07:16:08 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314
Nov 30 07:16:08 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:16:08 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:16:08 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:16:08 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:16:08 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:16:08 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db
Nov 30 07:16:08 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:16:08 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:16:08 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5
Nov 30 07:16:08 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:16:08 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:16:08 user nova-compute[75293]: FIRMWARE:
Nov 30 07:16:08 user nova-compute[75293]: No targets found.
Nov 30 07:16:08 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:16:08 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:16:08 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd82d78f-db46-48bb-baf5-d6054812caa7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba590517-1248-426a-b6a8-a6b444f990b2]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:16:08 user nova-compute[75293]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:16:08 user nova-compute[75293]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:16:08 user nova-compute[75293]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:16:08 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 (non-flash)
Nov 30 07:16:08 user nova-compute[75293]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:16:08 user nova-compute[75293]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:16:08 user nova-compute[75293]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:16:08 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe83c30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5'): ({'sde'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Removing single pathed devices sde {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6ea34c-7184-48a3-b4ed-b0fb28d0c657]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[378415b5-7c9e-4338-9c3d-21c0801b2894]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Flushing IO for device /dev/sde {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b619a4f-e5a3-406c-9668-6c9abb780430]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aef3e95-d14f-489a-8792-fc14df2220d5]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] SCSI volumes sde have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[96458d9b-421e-4645-b611-7603f99f7e0d]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[618d95f6-6b7a-42e1-8457-fcb846cd99bf]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5, portal: 172.16.0.220,3260]
Nov 30 07:16:09 user nova-compute[75293]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5, portal: 172.16.0.220,3260] successful.
Nov 30 07:16:09 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bf2351-4111-4c11-b609-97a218ac8ba5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c2cd80-9a2c-457d-9f5c-482a904b3161]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] <== disconnect_volume: return (332ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG nova.network.neutron [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Updating instance_info_cache with network_info: [{"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Releasing lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG nova.compute.manager [req-457e8702-4292-4c7e-8270-917d58629607 req-3c885e15-96dc-4e75-b502-c238ab134daf service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Received event network-vif-plugged-cbfcdcde-3eb5-4718-9e72-f0bc28211827 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-457e8702-4292-4c7e-8270-917d58629607 req-3c885e15-96dc-4e75-b502-c238ab134daf service nova] Acquiring lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-457e8702-4292-4c7e-8270-917d58629607 req-3c885e15-96dc-4e75-b502-c238ab134daf service nova] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-457e8702-4292-4c7e-8270-917d58629607 req-3c885e15-96dc-4e75-b502-c238ab134daf service nova] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG nova.compute.manager [req-457e8702-4292-4c7e-8270-917d58629607 req-3c885e15-96dc-4e75-b502-c238ab134daf service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] No waiting events found dispatching network-vif-plugged-cbfcdcde-3eb5-4718-9e72-f0bc28211827 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:09 user nova-compute[75293]: WARNING nova.compute.manager [req-457e8702-4292-4c7e-8270-917d58629607 req-3c885e15-96dc-4e75-b502-c238ab134daf service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Received unexpected event network-vif-plugged-cbfcdcde-3eb5-4718-9e72-f0bc28211827 for instance with vm_state building and task_state spawning.
Nov 30 07:16:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:09 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Instance destroyed successfully.
Nov 30 07:16:09 user nova-compute[75293]: DEBUG nova.objects.instance [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lazy-loading 'resources' on Instance uuid 677602ec-88fd-4026-8112-8469855f8a78 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:14:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-770610968',display_name='tempest-TestShelveInstance-server-770610968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-770610968',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLM1q2xWwt8nZI6FCB7oMRauNhjDcCuEsDd6hTQ69yj0BH9+/FJi552VJ2tgJb+JE66cg7iUXvN2C/cnao+LM3IbIqZxCcYZKEkU6EmLjbe4gKvpfOHWja2udvl5EpNvCw==',key_name='tempest-TestShelveInstance-816209512',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:14:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb68dc3daea04910bc7f11d6acdd91a6',ramdisk_id='',reservation_id='r-u75fgbpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-620093432',owner_user_name='tempest-TestShelveInstance-620093432-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:14:34Z,user_data=None,user_id='1470bbdb1f494cca880294d2e97d3a01',uuid=677602ec-88fd-4026-8112-8469855f8a78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Converting VIF {"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=814f9aa9-6974-4b76-96ba-52668f19b3f1,network=Network(c9521d26-96fd-4c02-88a6-c6cc9d945905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f9aa9-69') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG os_vif [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=814f9aa9-6974-4b76-96ba-52668f19b3f1,network=Network(c9521d26-96fd-4c02-88a6-c6cc9d945905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f9aa9-69') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap814f9aa9-69, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a9cea64-f136-4a8c-b5e6-006105840744) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:09 user nova-compute[75293]: INFO os_vif [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=814f9aa9-6974-4b76-96ba-52668f19b3f1,network=Network(c9521d26-96fd-4c02-88a6-c6cc9d945905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f9aa9-69')
Nov 30 07:16:09 user nova-compute[75293]: DEBUG nova.objects.instance [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lazy-loading 'flavor' on Instance uuid 009f70bc-7561-48fe-ba47-ebaf4d81d462 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YnWrPTdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:16:09 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:16:09 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d750a79a-d56d-47cb-8dd3-676ab175a780]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:16:09 user nova-compute[75293]: No targets found.
Nov 30 07:16:09 user nova-compute[75293]: iSNS:
Nov 30 07:16:09 user nova-compute[75293]: No targets found.
Nov 30 07:16:09 user nova-compute[75293]: STATIC:
Nov 30 07:16:09 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314
Nov 30 07:16:09 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:16:09 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:16:09 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:16:09 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:16:09 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:16:09 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db
Nov 30 07:16:09 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:16:09 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:16:09 user nova-compute[75293]: FIRMWARE:
Nov 30 07:16:09 user nova-compute[75293]: No targets found.
Nov 30 07:16:09 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:16:09 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:16:09 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:16:09 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-877a328e-104b-4cf0-8a33-d11dbb856879 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.924s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa65f68-8f0f-4456-96b6-2837f109d973]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a452c08-ec8e-4395-ba0a-7084d2abec72]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:16:10 user nova-compute[75293]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:16:10 user nova-compute[75293]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:16:10 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:16:10 user nova-compute[75293]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:16:10 user nova-compute[75293]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:16:10 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe83d4430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314'): ({'sdb'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Removing single pathed devices sdb {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c9a68a-2754-4623-a7f5-a2a9ef6e7358]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG nova.compute.manager [req-e2c321f8-968c-4551-90db-72d4f4721527 req-212185a0-dc69-4631-ab03-036ff7ebc337 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received event network-vif-plugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e2c321f8-968c-4551-90db-72d4f4721527 req-212185a0-dc69-4631-ab03-036ff7ebc337 service nova] Acquiring lock "677602ec-88fd-4026-8112-8469855f8a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e2c321f8-968c-4551-90db-72d4f4721527 req-212185a0-dc69-4631-ab03-036ff7ebc337 service nova] Lock "677602ec-88fd-4026-8112-8469855f8a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e2c321f8-968c-4551-90db-72d4f4721527 req-212185a0-dc69-4631-ab03-036ff7ebc337 service nova] Lock "677602ec-88fd-4026-8112-8469855f8a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG nova.compute.manager [req-e2c321f8-968c-4551-90db-72d4f4721527 req-212185a0-dc69-4631-ab03-036ff7ebc337 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] No waiting events found dispatching network-vif-plugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:10 user nova-compute[75293]: WARNING nova.compute.manager [req-e2c321f8-968c-4551-90db-72d4f4721527 req-212185a0-dc69-4631-ab03-036ff7ebc337 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received unexpected event network-vif-plugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 for instance with vm_state active and task_state shelving.
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed955ff-19c8-4220-928b-7183430b42ec]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Flushing IO for device /dev/sdb {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b79e2ba-48b0-42b5-86f5-4998bee7ebee]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dd5dc0-fbec-4fb2-aa5f-66f70a4b2bd4]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c66919-dc3a-486f-b158-fc1f403ff132]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c318f2ab-0e7e-461a-9071-d331c90522f5]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314, portal: 172.16.0.220,3260]
Nov 30 07:16:10 user nova-compute[75293]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314, portal: 172.16.0.220,3260] successful.
Nov 30 07:16:10 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a8826d-9334-4cf9-838d-898fbc88ade8]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] <== disconnect_volume: return (289ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:16:10 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Deleting instance files /opt/stack/data/nova/instances/677602ec-88fd-4026-8112-8469855f8a78_del
Nov 30 07:16:10 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Deletion of /opt/stack/data/nova/instances/677602ec-88fd-4026-8112-8469855f8a78_del complete
Nov 30 07:16:10 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLiXFvwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:16:10 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:16:10 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:16:10 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc4e6a8-599c-4054-a741-8befe410b419]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:16:10 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c8b7ce-05be-4e27-af00-7470227391af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c] added
Nov 30 07:16:10 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80fca08-4ea2-4f76-97ab-4d09e1ca031b]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2e2c26-9fb0-4fae-8756-3e3e2c28da8c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GLiXFvwx {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GLiXFvwx" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[01172dd0-6185-4275-ad47-032644c143f6]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GLiXFvwx'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0df099-4e6e-4875-8f73-afcd0111abdb]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a30c885-5d57-4c81-ae7c-ca32da36f911]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:16:10 user nova-compute[75293]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:16:10 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:16:10 user nova-compute[75293]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:16:10 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e995ff-0929-4aae-92a4-67054217b78d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c, portal: 172.16.0.220,3260]
Nov 30 07:16:10 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c, portal: 172.16.0.220,3260] successful.
Nov 30 07:16:10 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f216aff0-256f-4974-81ff-aeb8ef9e52dd]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c5e360-f9c3-44c6-8c60-3d67e13fba9f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:16:10 user nova-compute[75293]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:16:10 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:16:10 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:16:10 user nova-compute[75293]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:16:10 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:16:10 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac698314-0fc1-4d21-a5af-42e708edab60]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:10 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: None {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:16:11 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Instance spawned successfully.
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:16:11 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Deleted allocations for instance 677602ec-88fd-4026-8112-8469855f8a78
Nov 30 07:16:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.objects.instance [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lazy-loading 'numa_topology' on Instance uuid 677602ec-88fd-4026-8112-8469855f8a78 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.objects.base [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Object Instance<677602ec-88fd-4026-8112-8469855f8a78> lazy-loaded attributes: resources,numa_topology {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-2e54d83c-116a-46d4-8fe8-05a15dafb51f req-8485f22b-cc26-4c75-96be-e1d2915844eb service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Received event network-vif-plugged-cbfcdcde-3eb5-4718-9e72-f0bc28211827 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2e54d83c-116a-46d4-8fe8-05a15dafb51f req-8485f22b-cc26-4c75-96be-e1d2915844eb service nova] Acquiring lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2e54d83c-116a-46d4-8fe8-05a15dafb51f req-8485f22b-cc26-4c75-96be-e1d2915844eb service nova] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2e54d83c-116a-46d4-8fe8-05a15dafb51f req-8485f22b-cc26-4c75-96be-e1d2915844eb service nova] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-2e54d83c-116a-46d4-8fe8-05a15dafb51f req-8485f22b-cc26-4c75-96be-e1d2915844eb service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] No waiting events found dispatching network-vif-plugged-cbfcdcde-3eb5-4718-9e72-f0bc28211827 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:11 user nova-compute[75293]: WARNING nova.compute.manager [req-2e54d83c-116a-46d4-8fe8-05a15dafb51f req-8485f22b-cc26-4c75-96be-e1d2915844eb service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Received unexpected event network-vif-plugged-cbfcdcde-3eb5-4718-9e72-f0bc28211827 for instance with vm_state building and task_state spawning.
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-2e54d83c-116a-46d4-8fe8-05a15dafb51f req-8485f22b-cc26-4c75-96be-e1d2915844eb service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received event network-changed-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-2e54d83c-116a-46d4-8fe8-05a15dafb51f req-8485f22b-cc26-4c75-96be-e1d2915844eb service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Refreshing instance network info cache due to event network-changed-814f9aa9-6974-4b76-96ba-52668f19b3f1. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2e54d83c-116a-46d4-8fe8-05a15dafb51f req-8485f22b-cc26-4c75-96be-e1d2915844eb service nova] Acquiring lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2e54d83c-116a-46d4-8fe8-05a15dafb51f req-8485f22b-cc26-4c75-96be-e1d2915844eb service nova] Acquired lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.network.neutron [req-2e54d83c-116a-46d4-8fe8-05a15dafb51f req-8485f22b-cc26-4c75-96be-e1d2915844eb service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Refreshing network info cache for port 814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:16:11 user nova-compute[75293]: INFO nova.compute.manager [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Took 6.23 seconds to spawn the instance on the hypervisor.
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:16:11 user nova-compute[75293]: INFO nova.compute.manager [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Took 7.08 seconds to build instance.
Nov 30 07:16:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ae3b29d4-52d8-4920-b928-3df9d85d0c54 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.173s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-b97d8f1a-6f9b-43cd-bf20-531313948ac4 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "677602ec-88fd-4026-8112-8469855f8a78" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.403s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.network.neutron [req-2e54d83c-116a-46d4-8fe8-05a15dafb51f req-8485f22b-cc26-4c75-96be-e1d2915844eb service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Updated VIF entry in instance network info cache for port 814f9aa9-6974-4b76-96ba-52668f19b3f1. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.network.neutron [req-2e54d83c-116a-46d4-8fe8-05a15dafb51f req-8485f22b-cc26-4c75-96be-e1d2915844eb service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Updating instance_info_cache with network_info: [{"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": null, "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap814f9aa9-69", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2e54d83c-116a-46d4-8fe8-05a15dafb51f req-8485f22b-cc26-4c75-96be-e1d2915844eb service nova] Releasing lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLiXFvwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23939643034653739', 'path': '/dev/sdb'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939643034653739', 'path': '/dev/sdb'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.objects.instance [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lazy-loading 'flavor' on Instance uuid 9295d423-d71c-436b-9306-e0b386a0011f {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:16:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:16:11 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:16:11 user nova-compute[75293]:   <source dev="/dev/sdb"/>
Nov 30 07:16:11 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:16:11 user nova-compute[75293]:   <serial>a9d31834-8af6-4f2b-b597-74b774d2e19c</serial>
Nov 30 07:16:11 user nova-compute[75293]: </disk>
Nov 30 07:16:11 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:16:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:16:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:16:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] No VIF found with MAC fa:16:3e:93:db:1e, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:16:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7a8b091c-6575-440b-a035-71f552068cfe tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "9295d423-d71c-436b-9306-e0b386a0011f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.999s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:14 user nova-compute[75293]: DEBUG nova.compute.manager [req-b7a9431a-7e5d-409b-9bc2-37b3953f98da req-fcf3ad20-30bb-4b49-97f8-2d2d8e02e1e9 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received event network-changed-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:14 user nova-compute[75293]: DEBUG nova.compute.manager [req-b7a9431a-7e5d-409b-9bc2-37b3953f98da req-fcf3ad20-30bb-4b49-97f8-2d2d8e02e1e9 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Refreshing instance network info cache due to event network-changed-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:16:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b7a9431a-7e5d-409b-9bc2-37b3953f98da req-fcf3ad20-30bb-4b49-97f8-2d2d8e02e1e9 service nova] Acquiring lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:16:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b7a9431a-7e5d-409b-9bc2-37b3953f98da req-fcf3ad20-30bb-4b49-97f8-2d2d8e02e1e9 service nova] Acquired lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:16:14 user nova-compute[75293]: DEBUG nova.network.neutron [req-b7a9431a-7e5d-409b-9bc2-37b3953f98da req-fcf3ad20-30bb-4b49-97f8-2d2d8e02e1e9 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Refreshing network info cache for port 0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:16:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:14 user nova-compute[75293]: DEBUG nova.network.neutron [req-b7a9431a-7e5d-409b-9bc2-37b3953f98da req-fcf3ad20-30bb-4b49-97f8-2d2d8e02e1e9 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Updated VIF entry in instance network info cache for port 0b39fc27-6fcb-4dfe-b948-2d0f4f172b48. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:16:14 user nova-compute[75293]: DEBUG nova.network.neutron [req-b7a9431a-7e5d-409b-9bc2-37b3953f98da req-fcf3ad20-30bb-4b49-97f8-2d2d8e02e1e9 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Updating instance_info_cache with network_info: [{"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:16:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b7a9431a-7e5d-409b-9bc2-37b3953f98da req-fcf3ad20-30bb-4b49-97f8-2d2d8e02e1e9 service nova] Releasing lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:16:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-52c0f9b2-0f6f-4a1f-a8d6-11f0d25f607f req-5b796f36-84c0-4683-b861-3253c166b8b0 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received event network-changed-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-52c0f9b2-0f6f-4a1f-a8d6-11f0d25f607f req-5b796f36-84c0-4683-b861-3253c166b8b0 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Refreshing instance network info cache due to event network-changed-4367d997-9d95-45a9-9a95-ddb8a27595c6. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:16:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-52c0f9b2-0f6f-4a1f-a8d6-11f0d25f607f req-5b796f36-84c0-4683-b861-3253c166b8b0 service nova] Acquiring lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:16:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-52c0f9b2-0f6f-4a1f-a8d6-11f0d25f607f req-5b796f36-84c0-4683-b861-3253c166b8b0 service nova] Acquired lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:16:15 user nova-compute[75293]: DEBUG nova.network.neutron [req-52c0f9b2-0f6f-4a1f-a8d6-11f0d25f607f req-5b796f36-84c0-4683-b861-3253c166b8b0 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Refreshing network info cache for port 4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:16:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:16 user nova-compute[75293]: DEBUG nova.network.neutron [req-52c0f9b2-0f6f-4a1f-a8d6-11f0d25f607f req-5b796f36-84c0-4683-b861-3253c166b8b0 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Updated VIF entry in instance network info cache for port 4367d997-9d95-45a9-9a95-ddb8a27595c6. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:16:16 user nova-compute[75293]: DEBUG nova.network.neutron [req-52c0f9b2-0f6f-4a1f-a8d6-11f0d25f607f req-5b796f36-84c0-4683-b861-3253c166b8b0 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Updating instance_info_cache with network_info: [{"id": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "address": "fa:16:3e:93:db:1e", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4367d997-9d", "ovs_interfaceid": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:16:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-52c0f9b2-0f6f-4a1f-a8d6-11f0d25f607f req-5b796f36-84c0-4683-b861-3253c166b8b0 service nova] Releasing lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:16:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-d66cdb02-f535-402f-a712-f569ec01beba req-990df716-ea32-4a6e-806a-d11afef4ae7b service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Received event network-changed-b47caadd-df9c-46df-99fe-24210b7a4f1c {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-d66cdb02-f535-402f-a712-f569ec01beba req-990df716-ea32-4a6e-806a-d11afef4ae7b service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Refreshing instance network info cache due to event network-changed-b47caadd-df9c-46df-99fe-24210b7a4f1c. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:16:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d66cdb02-f535-402f-a712-f569ec01beba req-990df716-ea32-4a6e-806a-d11afef4ae7b service nova] Acquiring lock "refresh_cache-d34f99fc-343e-4e8a-83e6-372b0326bded" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:16:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d66cdb02-f535-402f-a712-f569ec01beba req-990df716-ea32-4a6e-806a-d11afef4ae7b service nova] Acquired lock "refresh_cache-d34f99fc-343e-4e8a-83e6-372b0326bded" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:16:17 user nova-compute[75293]: DEBUG nova.network.neutron [req-d66cdb02-f535-402f-a712-f569ec01beba req-990df716-ea32-4a6e-806a-d11afef4ae7b service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Refreshing network info cache for port b47caadd-df9c-46df-99fe-24210b7a4f1c {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG nova.compute.manager [req-227dcdd3-b423-428b-a1fd-29e4c3a65a29 req-53a769f3-d1f3-429d-9b61-23dff1119aae service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received event network-changed-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG nova.compute.manager [req-227dcdd3-b423-428b-a1fd-29e4c3a65a29 req-53a769f3-d1f3-429d-9b61-23dff1119aae service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Refreshing instance network info cache due to event network-changed-4367d997-9d95-45a9-9a95-ddb8a27595c6. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-227dcdd3-b423-428b-a1fd-29e4c3a65a29 req-53a769f3-d1f3-429d-9b61-23dff1119aae service nova] Acquiring lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-227dcdd3-b423-428b-a1fd-29e4c3a65a29 req-53a769f3-d1f3-429d-9b61-23dff1119aae service nova] Acquired lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG nova.network.neutron [req-227dcdd3-b423-428b-a1fd-29e4c3a65a29 req-53a769f3-d1f3-429d-9b61-23dff1119aae service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Refreshing network info cache for port 4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "d34f99fc-343e-4e8a-83e6-372b0326bded" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "d34f99fc-343e-4e8a-83e6-372b0326bded" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG nova.objects.instance [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lazy-loading 'flavor' on Instance uuid d34f99fc-343e-4e8a-83e6-372b0326bded {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "39042069-ac9b-4b13-b486-c845e84ac041" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "39042069-ac9b-4b13-b486-c845e84ac041" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:18 user nova-compute[75293]: INFO nova.compute.manager [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Shelving
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "d34f99fc-343e-4e8a-83e6-372b0326bded" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG nova.network.neutron [req-d66cdb02-f535-402f-a712-f569ec01beba req-990df716-ea32-4a6e-806a-d11afef4ae7b service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Updated VIF entry in instance network info cache for port b47caadd-df9c-46df-99fe-24210b7a4f1c. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG nova.network.neutron [req-d66cdb02-f535-402f-a712-f569ec01beba req-990df716-ea32-4a6e-806a-d11afef4ae7b service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Updating instance_info_cache with network_info: [{"id": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "address": "fa:16:3e:d8:cd:81", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47caadd-df", "ovs_interfaceid": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d66cdb02-f535-402f-a712-f569ec01beba req-990df716-ea32-4a6e-806a-d11afef4ae7b service nova] Releasing lock "refresh_cache-d34f99fc-343e-4e8a-83e6-372b0326bded" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "d34f99fc-343e-4e8a-83e6-372b0326bded" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "d34f99fc-343e-4e8a-83e6-372b0326bded" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:18 user nova-compute[75293]: INFO nova.compute.manager [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Attaching volume 8c88a46b-c7b8-4748-b168-f240b60a4b31 to /dev/vdb
Nov 30 07:16:18 user nova-compute[75293]: DEBUG os_brick.utils [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f458a8-d94a-4644-ab4a-825bb48e90f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6153adb3-a94a-4583-8990-c904c7b5611a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5581b4a7-22ce-4bd8-bbd0-82763661635b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8320f1fc-fa29-45d0-8914-321eecc2cfd9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:16:18 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:16:18 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d30a5da-d05e-4911-9748-04d8e3c75d68]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG os_brick.utils [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Updating existing volume attachment record: 9c372d58-4bb3-4254-beb1-20ca2e2bc55d {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:19 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Instance destroyed successfully.
Nov 30 07:16:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8a864f0e-45c5-4b51-94ee-deea80659682 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "9295d423-d71c-436b-9306-e0b386a0011f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8a864f0e-45c5-4b51-94ee-deea80659682 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "9295d423-d71c-436b-9306-e0b386a0011f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:19 user nova-compute[75293]: INFO nova.compute.manager [None req-8a864f0e-45c5-4b51-94ee-deea80659682 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Rebooting instance
Nov 30 07:16:19 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Beginning cold snapshot process
Nov 30 07:16:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG nova.network.neutron [req-227dcdd3-b423-428b-a1fd-29e4c3a65a29 req-53a769f3-d1f3-429d-9b61-23dff1119aae service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Updated VIF entry in instance network info cache for port 4367d997-9d95-45a9-9a95-ddb8a27595c6. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG nova.network.neutron [req-227dcdd3-b423-428b-a1fd-29e4c3a65a29 req-53a769f3-d1f3-429d-9b61-23dff1119aae service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Updating instance_info_cache with network_info: [{"id": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "address": "fa:16:3e:93:db:1e", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4367d997-9d", "ovs_interfaceid": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-227dcdd3-b423-428b-a1fd-29e4c3a65a29 req-53a769f3-d1f3-429d-9b61-23dff1119aae service nova] Releasing lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8a864f0e-45c5-4b51-94ee-deea80659682 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8a864f0e-45c5-4b51-94ee-deea80659682 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquired lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8a864f0e-45c5-4b51-94ee-deea80659682 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG nova.privsep.utils [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75293) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk /opt/stack/data/nova/instances/snapshots/tmpfp_9nqh2/e8663f7ed0144dd183c9e166c328a0fd {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk /opt/stack/data/nova/instances/snapshots/tmpfp_9nqh2/e8663f7ed0144dd183c9e166c328a0fd" returned: 0 in 0.771s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:20 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Snapshot extracted, beginning image upload
Nov 30 07:16:20 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8a864f0e-45c5-4b51-94ee-deea80659682 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Updating instance_info_cache with network_info: [{"id": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "address": "fa:16:3e:93:db:1e", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4367d997-9d", "ovs_interfaceid": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8a864f0e-45c5-4b51-94ee-deea80659682 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Releasing lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8a864f0e-45c5-4b51-94ee-deea80659682 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received event network-vif-unplugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] Acquiring lock "39042069-ac9b-4b13-b486-c845e84ac041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] No waiting events found dispatching network-vif-unplugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:20 user nova-compute[75293]: WARNING nova.compute.manager [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received unexpected event network-vif-unplugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 for instance with vm_state active and task_state shelving_image_uploading.
Nov 30 07:16:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received event network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] Acquiring lock "39042069-ac9b-4b13-b486-c845e84ac041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] No waiting events found dispatching network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:20 user nova-compute[75293]: WARNING nova.compute.manager [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received unexpected event network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 for instance with vm_state active and task_state shelving_image_uploading.
Nov 30 07:16:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received event network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] Acquiring lock "39042069-ac9b-4b13-b486-c845e84ac041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] No waiting events found dispatching network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:20 user nova-compute[75293]: WARNING nova.compute.manager [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received unexpected event network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 for instance with vm_state active and task_state shelving_image_uploading.
Nov 30 07:16:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received event network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] Acquiring lock "39042069-ac9b-4b13-b486-c845e84ac041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] No waiting events found dispatching network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:20 user nova-compute[75293]: WARNING nova.compute.manager [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received unexpected event network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 for instance with vm_state active and task_state shelving_image_uploading.
Nov 30 07:16:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received event network-vif-unplugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] Acquiring lock "39042069-ac9b-4b13-b486-c845e84ac041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] No waiting events found dispatching network-vif-unplugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:20 user nova-compute[75293]: WARNING nova.compute.manager [req-a364303f-858f-4b6f-9013-77b872b74bbc req-5b151a79-b3c0-47ce-8ccc-1da4eb30e078 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received unexpected event network-vif-unplugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 for instance with vm_state active and task_state shelving_image_uploading.
Nov 30 07:16:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:22 user nova-compute[75293]: DEBUG nova.compute.manager [req-bfeb940e-2b36-4fdf-bc17-bffdb6c930e4 req-c5407fee-4a0b-4ffb-9a1c-a1518520cbe8 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received event network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-bfeb940e-2b36-4fdf-bc17-bffdb6c930e4 req-c5407fee-4a0b-4ffb-9a1c-a1518520cbe8 service nova] Acquiring lock "39042069-ac9b-4b13-b486-c845e84ac041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-bfeb940e-2b36-4fdf-bc17-bffdb6c930e4 req-c5407fee-4a0b-4ffb-9a1c-a1518520cbe8 service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-bfeb940e-2b36-4fdf-bc17-bffdb6c930e4 req-c5407fee-4a0b-4ffb-9a1c-a1518520cbe8 service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:22 user nova-compute[75293]: DEBUG nova.compute.manager [req-bfeb940e-2b36-4fdf-bc17-bffdb6c930e4 req-c5407fee-4a0b-4ffb-9a1c-a1518520cbe8 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] No waiting events found dispatching network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:22 user nova-compute[75293]: WARNING nova.compute.manager [req-bfeb940e-2b36-4fdf-bc17-bffdb6c930e4 req-c5407fee-4a0b-4ffb-9a1c-a1518520cbe8 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received unexpected event network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 for instance with vm_state active and task_state shelving_image_uploading.
Nov 30 07:16:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:22 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Snapshot image upload complete
Nov 30 07:16:22 user nova-compute[75293]: DEBUG nova.compute.manager [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:16:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:22 user nova-compute[75293]: INFO nova.compute.manager [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Shelve offloading
Nov 30 07:16:22 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Instance destroyed successfully.
Nov 30 07:16:22 user nova-compute[75293]: DEBUG nova.compute.manager [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:16:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:16:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquired lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:16:22 user nova-compute[75293]: DEBUG nova.network.neutron [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:16:23 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-8a864f0e-45c5-4b51-94ee-deea80659682 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Instance shutdown successfully.
Nov 30 07:16:23 user nova-compute[75293]: DEBUG nova.network.neutron [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Updating instance_info_cache with network_info: [{"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:16:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Releasing lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:16:24 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Instance destroyed successfully.
Nov 30 07:16:24 user nova-compute[75293]: DEBUG nova.objects.instance [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'resources' on Instance uuid 39042069-ac9b-4b13-b486-c845e84ac041 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1239175050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1239175050',id=20,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzh49xi4NKMy4+Uk32rDD+TSdJf8Z6DRpGQmUiy7rQ8et62Zs3i28YpatQsKbwR1lGArGLXID3uOAjriRvxQM2+wm39B3BWMLufpvqn6wVgUGwByVJFVVsJ7v/OaR0ZEQ==',key_name='tempest-keypair-1386254430',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:14:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='18aa2f5bea3d44ecb10ff083d6f76038',ramdisk_id='',reservation_id='r-j3ig0f6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-763079906',owner_user_name='tempest-AttachVolumeShelveTestJSON-763079906-project-member',shelved_at='2023-11-30T07:16:22.746756',shelved_host='user',shelved_image_id='eedea5a5-2f0b-4278-a7d6-cfe8adad5e38'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:16:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e385a89f913645dd9fd2770e6e7445da',uuid=39042069-ac9b-4b13-b486-c845e84ac041,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converting VIF {"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=0b39fc27-6fcb-4dfe-b948-2d0f4f172b48,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b39fc27-6f') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG os_vif [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=0b39fc27-6fcb-4dfe-b948-2d0f4f172b48,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b39fc27-6f') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b39fc27-6f, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1fdab90b-b8d8-4f17-a335-9e2694288323) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:24 user nova-compute[75293]: INFO os_vif [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=0b39fc27-6fcb-4dfe-b948-2d0f4f172b48,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b39fc27-6f')
Nov 30 07:16:24 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Deleting instance files /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041_del
Nov 30 07:16:24 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Deletion of /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041_del complete
Nov 30 07:16:24 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Deleted allocations for instance 39042069-ac9b-4b13-b486-c845e84ac041
Nov 30 07:16:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received event network-vif-unplugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] Acquiring lock "9295d423-d71c-436b-9306-e0b386a0011f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] Lock "9295d423-d71c-436b-9306-e0b386a0011f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] Lock "9295d423-d71c-436b-9306-e0b386a0011f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] No waiting events found dispatching network-vif-unplugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:24 user nova-compute[75293]: WARNING nova.compute.manager [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received unexpected event network-vif-unplugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 for instance with vm_state active and task_state reboot_started.
Nov 30 07:16:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received event network-vif-plugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] Acquiring lock "9295d423-d71c-436b-9306-e0b386a0011f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] Lock "9295d423-d71c-436b-9306-e0b386a0011f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] Lock "9295d423-d71c-436b-9306-e0b386a0011f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] No waiting events found dispatching network-vif-plugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:24 user nova-compute[75293]: WARNING nova.compute.manager [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received unexpected event network-vif-plugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 for instance with vm_state active and task_state reboot_started.
Nov 30 07:16:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received event network-changed-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Refreshing instance network info cache due to event network-changed-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] Acquiring lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] Acquired lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG nova.network.neutron [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Refreshing network info cache for port 0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG nova.objects.instance [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'numa_topology' on Instance uuid 39042069-ac9b-4b13-b486-c845e84ac041 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG nova.objects.base [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Object Instance<39042069-ac9b-4b13-b486-c845e84ac041> lazy-loaded attributes: resources,numa_topology {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:16:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5ab9d519-d860-44a2-adb8-aec06a088fee tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "39042069-ac9b-4b13-b486-c845e84ac041" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.633s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:25 user nova-compute[75293]: DEBUG nova.network.neutron [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Updated VIF entry in instance network info cache for port 0b39fc27-6fcb-4dfe-b948-2d0f4f172b48. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:16:25 user nova-compute[75293]: DEBUG nova.network.neutron [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Updating instance_info_cache with network_info: [{"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:16:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d5f489a5-d9e8-4222-a3a1-2e251ff471f8 req-e5f660cf-8a2c-4257-b8df-6d3c26e02736 service nova] Releasing lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:16:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-4273eb2f-384c-4e70-82fd-5fefa12d2553 req-273a94e0-ae7e-4d4f-9e51-206f66a6db29 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received event network-vif-plugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4273eb2f-384c-4e70-82fd-5fefa12d2553 req-273a94e0-ae7e-4d4f-9e51-206f66a6db29 service nova] Acquiring lock "9295d423-d71c-436b-9306-e0b386a0011f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4273eb2f-384c-4e70-82fd-5fefa12d2553 req-273a94e0-ae7e-4d4f-9e51-206f66a6db29 service nova] Lock "9295d423-d71c-436b-9306-e0b386a0011f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4273eb2f-384c-4e70-82fd-5fefa12d2553 req-273a94e0-ae7e-4d4f-9e51-206f66a6db29 service nova] Lock "9295d423-d71c-436b-9306-e0b386a0011f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-4273eb2f-384c-4e70-82fd-5fefa12d2553 req-273a94e0-ae7e-4d4f-9e51-206f66a6db29 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] No waiting events found dispatching network-vif-plugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:26 user nova-compute[75293]: WARNING nova.compute.manager [req-4273eb2f-384c-4e70-82fd-5fefa12d2553 req-273a94e0-ae7e-4d4f-9e51-206f66a6db29 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received unexpected event network-vif-plugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 for instance with vm_state active and task_state reboot_started.
Nov 30 07:16:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-4273eb2f-384c-4e70-82fd-5fefa12d2553 req-273a94e0-ae7e-4d4f-9e51-206f66a6db29 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received event network-vif-plugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4273eb2f-384c-4e70-82fd-5fefa12d2553 req-273a94e0-ae7e-4d4f-9e51-206f66a6db29 service nova] Acquiring lock "9295d423-d71c-436b-9306-e0b386a0011f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4273eb2f-384c-4e70-82fd-5fefa12d2553 req-273a94e0-ae7e-4d4f-9e51-206f66a6db29 service nova] Lock "9295d423-d71c-436b-9306-e0b386a0011f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4273eb2f-384c-4e70-82fd-5fefa12d2553 req-273a94e0-ae7e-4d4f-9e51-206f66a6db29 service nova] Lock "9295d423-d71c-436b-9306-e0b386a0011f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-4273eb2f-384c-4e70-82fd-5fefa12d2553 req-273a94e0-ae7e-4d4f-9e51-206f66a6db29 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] No waiting events found dispatching network-vif-plugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:26 user nova-compute[75293]: WARNING nova.compute.manager [req-4273eb2f-384c-4e70-82fd-5fefa12d2553 req-273a94e0-ae7e-4d4f-9e51-206f66a6db29 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received unexpected event network-vif-plugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 for instance with vm_state active and task_state reboot_started.
Nov 30 07:16:26 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Instance running successfully.
Nov 30 07:16:26 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-8a864f0e-45c5-4b51-94ee-deea80659682 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Instance soft rebooted successfully.
Nov 30 07:16:26 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8a864f0e-45c5-4b51-94ee-deea80659682 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:16:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8a864f0e-45c5-4b51-94ee-deea80659682 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "9295d423-d71c-436b-9306-e0b386a0011f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.958s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:16:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qygiNSdP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:16:27 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:16:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:16:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:16:27 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:16:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:16:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:16:27 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:16:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:27 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e803bf-f3d4-4575-bedf-509c287035cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:16:27 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:27 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce14166b-acfb-46af-af19-56a39b81ccc3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31] added
Nov 30 07:16:27 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[580e8acc-494c-4a15-a142-1314cb797a73]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c27910-1fcf-4465-9bb4-46e2c3289afa]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qygiNSdP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qygiNSdP" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[059967ff-6219-4678-a94c-b828b213b31b]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qygiNSdP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[845748dd-5dca-4dc8-a213-4fee410d6f7c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6f78bf-d733-4e75-900a-3f3f3a0d2ff5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:16:28 user nova-compute[75293]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:16:28 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:16:28 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:16:28 user nova-compute[75293]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:16:28 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:16:28 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df12071-c742-4e3b-98d9-7aff93a14f94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31, portal: 172.16.0.220,3260]
Nov 30 07:16:28 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31, portal: 172.16.0.220,3260] successful.
Nov 30 07:16:28 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f049c0-87d7-4bcf-98ed-87782aa48418]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[065aa794-e654-4b9b-8efc-fc9da3af5624]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:16:28 user nova-compute[75293]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:16:28 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:16:28 user nova-compute[75293]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 (non-flash)
Nov 30 07:16:28 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:16:28 user nova-compute[75293]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:16:28 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:16:28 user nova-compute[75293]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 (non-flash)
Nov 30 07:16:28 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b77152e-70c7-4ea4-9ad0-85b738d56a6d]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:16:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qygiNSdP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:16:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:16:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23766316139363432', 'path': '/dev/sde'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:16:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766316139363432', 'path': '/dev/sde'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:16:29 user nova-compute[75293]: DEBUG nova.objects.instance [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lazy-loading 'flavor' on Instance uuid d34f99fc-343e-4e8a-83e6-372b0326bded {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:16:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:16:29 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:16:29 user nova-compute[75293]:   <source dev="/dev/sde"/>
Nov 30 07:16:29 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:16:29 user nova-compute[75293]:   <serial>8c88a46b-c7b8-4748-b168-f240b60a4b31</serial>
Nov 30 07:16:29 user nova-compute[75293]: </disk>
Nov 30 07:16:29 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:16:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:16:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:16:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] No VIF found with MAC fa:16:3e:d8:cd:81, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:16:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-44484c51-5725-4b29-b010-1730153716c5 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "d34f99fc-343e-4e8a-83e6-372b0326bded" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.163s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "d34f99fc-343e-4e8a-83e6-372b0326bded" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "d34f99fc-343e-4e8a-83e6-372b0326bded" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:32 user nova-compute[75293]: INFO nova.compute.manager [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Detaching volume 8c88a46b-c7b8-4748-b168-f240b60a4b31
Nov 30 07:16:32 user nova-compute[75293]: INFO nova.virt.block_device [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Attempting to driver detach volume 8c88a46b-c7b8-4748-b168-f240b60a4b31 from mountpoint /dev/vdb
Nov 30 07:16:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Attempting to detach device vdb from instance d34f99fc-343e-4e8a-83e6-372b0326bded from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:16:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:16:32 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:16:32 user nova-compute[75293]:   <source dev="/dev/sde"/>
Nov 30 07:16:32 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:16:32 user nova-compute[75293]:   <serial>8c88a46b-c7b8-4748-b168-f240b60a4b31</serial>
Nov 30 07:16:32 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:16:32 user nova-compute[75293]: </disk>
Nov 30 07:16:32 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:16:32 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Successfully detached device vdb from instance d34f99fc-343e-4e8a-83e6-372b0326bded from the persistent domain config.
Nov 30 07:16:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d34f99fc-343e-4e8a-83e6-372b0326bded from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:16:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:16:32 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:16:32 user nova-compute[75293]:   <source dev="/dev/sde"/>
Nov 30 07:16:32 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:16:32 user nova-compute[75293]:   <serial>8c88a46b-c7b8-4748-b168-f240b60a4b31</serial>
Nov 30 07:16:32 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:16:32 user nova-compute[75293]: </disk>
Nov 30 07:16:32 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:16:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d34f99fc-343e-4e8a-83e6-372b0326bded {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:16:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:35 user nova-compute[75293]: DEBUG nova.compute.manager [req-b8311cb2-541f-4840-8f65-499daa90e5e7 req-40e45eed-55c6-4639-89b0-5130a4621398 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received event network-changed-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:35 user nova-compute[75293]: DEBUG nova.compute.manager [req-b8311cb2-541f-4840-8f65-499daa90e5e7 req-40e45eed-55c6-4639-89b0-5130a4621398 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Refreshing instance network info cache due to event network-changed-23b984e7-f18d-4c93-9720-0184ff3d6e0a. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:16:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b8311cb2-541f-4840-8f65-499daa90e5e7 req-40e45eed-55c6-4639-89b0-5130a4621398 service nova] Acquiring lock "refresh_cache-093deaa6-a68c-4688-9055-69dda63b6b4c" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:16:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b8311cb2-541f-4840-8f65-499daa90e5e7 req-40e45eed-55c6-4639-89b0-5130a4621398 service nova] Acquired lock "refresh_cache-093deaa6-a68c-4688-9055-69dda63b6b4c" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:16:35 user nova-compute[75293]: DEBUG nova.network.neutron [req-b8311cb2-541f-4840-8f65-499daa90e5e7 req-40e45eed-55c6-4639-89b0-5130a4621398 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Refreshing network info cache for port 23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:16:35 user nova-compute[75293]: DEBUG nova.network.neutron [req-b8311cb2-541f-4840-8f65-499daa90e5e7 req-40e45eed-55c6-4639-89b0-5130a4621398 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Updated VIF entry in instance network info cache for port 23b984e7-f18d-4c93-9720-0184ff3d6e0a. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:16:35 user nova-compute[75293]: DEBUG nova.network.neutron [req-b8311cb2-541f-4840-8f65-499daa90e5e7 req-40e45eed-55c6-4639-89b0-5130a4621398 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Updating instance_info_cache with network_info: [{"id": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "address": "fa:16:3e:e7:42:bf", "network": {"id": "1c0cc61f-f779-4846-a964-db0ac1ed358a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1209595465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b1b51e818e442ab5d4b68fede61c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b984e7-f1", "ovs_interfaceid": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:16:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b8311cb2-541f-4840-8f65-499daa90e5e7 req-40e45eed-55c6-4639-89b0-5130a4621398 service nova] Releasing lock "refresh_cache-093deaa6-a68c-4688-9055-69dda63b6b4c" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:16:36 user nova-compute[75293]: INFO nova.compute.manager [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Rebuilding instance
Nov 30 07:16:36 user nova-compute[75293]: DEBUG nova.compute.manager [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG nova.compute.manager [req-d83f35c6-1cf8-4367-be3d-187b131db3bc req-98476768-303a-4ae1-a087-3b8acb6faf8a service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received event network-vif-unplugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d83f35c6-1cf8-4367-be3d-187b131db3bc req-98476768-303a-4ae1-a087-3b8acb6faf8a service nova] Acquiring lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d83f35c6-1cf8-4367-be3d-187b131db3bc req-98476768-303a-4ae1-a087-3b8acb6faf8a service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d83f35c6-1cf8-4367-be3d-187b131db3bc req-98476768-303a-4ae1-a087-3b8acb6faf8a service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG nova.compute.manager [req-d83f35c6-1cf8-4367-be3d-187b131db3bc req-98476768-303a-4ae1-a087-3b8acb6faf8a service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] No waiting events found dispatching network-vif-unplugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:36 user nova-compute[75293]: WARNING nova.compute.manager [req-d83f35c6-1cf8-4367-be3d-187b131db3bc req-98476768-303a-4ae1-a087-3b8acb6faf8a service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received unexpected event network-vif-unplugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a for instance with vm_state active and task_state rebuilding.
Nov 30 07:16:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:36 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Instance destroyed successfully.
Nov 30 07:16:36 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Instance destroyed successfully.
Nov 30 07:16:36 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1257820242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1383728389',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkH/W6LW/O9P0TOjpBNyg9mPCr0F5RhJ5UC+vXQMDgOyUkNDLXMoQER4Pxz+57oxrldBInLqlDI69s4mUYzIevfjGRYjiPK6uYw3Yx4XEko0at9i+vwqVvb+4cGOb36ig==',key_name='tempest-keypair-558954396',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:15:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='30b1b51e818e442ab5d4b68fede61c3b',ramdisk_id='',reservation_id='r-1o3nhquy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-766996460',owner_user_name='tempest-ServerActionsV293TestJSON-766996460-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:16:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9359a918c1394350baf3814eac14c8f6',uuid=093deaa6-a68c-4688-9055-69dda63b6b4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "address": "fa:16:3e:e7:42:bf", "network": {"id": "1c0cc61f-f779-4846-a964-db0ac1ed358a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1209595465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b1b51e818e442ab5d4b68fede61c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b984e7-f1", "ovs_interfaceid": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Converting VIF {"id": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "address": "fa:16:3e:e7:42:bf", "network": {"id": "1c0cc61f-f779-4846-a964-db0ac1ed358a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1209595465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b1b51e818e442ab5d4b68fede61c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b984e7-f1", "ovs_interfaceid": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:42:bf,bridge_name='br-int',has_traffic_filtering=True,id=23b984e7-f18d-4c93-9720-0184ff3d6e0a,network=Network(1c0cc61f-f779-4846-a964-db0ac1ed358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b984e7-f1') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG os_vif [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:42:bf,bridge_name='br-int',has_traffic_filtering=True,id=23b984e7-f18d-4c93-9720-0184ff3d6e0a,network=Network(1c0cc61f-f779-4846-a964-db0ac1ed358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b984e7-f1') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23b984e7-f1, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d76035b-193d-4eb5-b38b-bb1420f393d8) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:16:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:16:37 user nova-compute[75293]: INFO os_vif [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:42:bf,bridge_name='br-int',has_traffic_filtering=True,id=23b984e7-f18d-4c93-9720-0184ff3d6e0a,network=Network(1c0cc61f-f779-4846-a964-db0ac1ed358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b984e7-f1')
Nov 30 07:16:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyFrHfeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:16:37 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[475a9a3b-073c-4b58-84be-09411135409c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:16:37 user nova-compute[75293]: No targets found.
Nov 30 07:16:37 user nova-compute[75293]: iSNS:
Nov 30 07:16:37 user nova-compute[75293]: No targets found.
Nov 30 07:16:37 user nova-compute[75293]: STATIC:
Nov 30 07:16:37 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c
Nov 30 07:16:37 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:16:37 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:16:37 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:16:37 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:16:37 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:16:37 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db
Nov 30 07:16:37 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:16:37 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:16:37 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31
Nov 30 07:16:37 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:16:37 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:16:37 user nova-compute[75293]: FIRMWARE:
Nov 30 07:16:37 user nova-compute[75293]: No targets found.
Nov 30 07:16:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:16:37 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:16:37 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[47458825-ae5a-4388-a6a7-3238539398f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6244dde-f575-4d5b-ae4f-203cde3d6db1]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:16:37 user nova-compute[75293]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:16:37 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:16:37 user nova-compute[75293]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 (non-flash)
Nov 30 07:16:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:16:37 user nova-compute[75293]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:16:37 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:16:37 user nova-compute[75293]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 (non-flash)
Nov 30 07:16:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effc8682b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db'): ({'sdc'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Removing single pathed devices sdc {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[575a42ed-8228-475b-9e26-fe51dce00dd1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac1c09e-8ef6-4132-9b1e-5f669fba48d2]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Flushing IO for device /dev/sdc {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a23a31-bad2-436f-9af5-2ff4afe53fde]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[baeb3379-d9b3-47a4-91f9-2bd03ec654b1]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2235c5fd-a0c7f2fce0df104b', '/dev/disk/by-id/scsi-26130633766326663', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2235c5fd') {{(pid=86417) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a34fe5-e317-4768-b079-2aced18e3da7]: (4, None) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcffb61-85a1-435a-9dab-4a02ce5f0dba]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d60b90b-55fe-480c-91d9-a86db85ce5c4]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db, portal: 172.16.0.220,3260]
Nov 30 07:16:37 user nova-compute[75293]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db, portal: 172.16.0.220,3260] successful.
Nov 30 07:16:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76058a5-33ce-4952-b5de-a6c2eed99f94]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] <== disconnect_volume: return (398ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:16:37 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Deleting instance files /opt/stack/data/nova/instances/093deaa6-a68c-4688-9055-69dda63b6b4c_del
Nov 30 07:16:37 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Deletion of /opt/stack/data/nova/instances/093deaa6-a68c-4688-9055-69dda63b6b4c_del complete
Nov 30 07:16:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:37 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 093deaa6-a68c-4688-9055-69dda63b6b4c could not be found.
Nov 30 07:16:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyFrHfeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:16:37 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73a74f5-d41e-429e-8ba9-7746c5a95f23]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:16:37 user nova-compute[75293]: No targets found.
Nov 30 07:16:37 user nova-compute[75293]: iSNS:
Nov 30 07:16:37 user nova-compute[75293]: No targets found.
Nov 30 07:16:37 user nova-compute[75293]: STATIC:
Nov 30 07:16:37 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c
Nov 30 07:16:37 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:16:37 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:16:37 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:16:37 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:16:37 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:16:37 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31
Nov 30 07:16:37 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:16:37 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:16:37 user nova-compute[75293]: FIRMWARE:
Nov 30 07:16:37 user nova-compute[75293]: No targets found.
Nov 30 07:16:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:16:37 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:16:37 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d671c65-0dd7-449e-a7cc-adc7d67b5634]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0e4d97-fa84-42b6-a94f-87c592c260da]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:16:37 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:16:37 user nova-compute[75293]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 (non-flash)
Nov 30 07:16:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:16:37 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:16:37 user nova-compute[75293]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 (non-flash)
Nov 30 07:16:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effc861e0e0>, {}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Disconnecting from: [] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.094s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] <== disconnect_volume: return (95ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:16:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "009f70bc-7561-48fe-ba47-ebaf4d81d462" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:38 user nova-compute[75293]: INFO nova.compute.manager [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Terminating instance
Nov 30 07:16:38 user nova-compute[75293]: DEBUG nova.compute.manager [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG nova.compute.manager [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received event network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] Acquiring lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG nova.compute.manager [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] No waiting events found dispatching network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:38 user nova-compute[75293]: WARNING nova.compute.manager [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received unexpected event network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a for instance with vm_state active and task_state rebuilding.
Nov 30 07:16:38 user nova-compute[75293]: DEBUG nova.compute.manager [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received event network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] Acquiring lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG nova.compute.manager [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] No waiting events found dispatching network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:38 user nova-compute[75293]: WARNING nova.compute.manager [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received unexpected event network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a for instance with vm_state active and task_state rebuilding.
Nov 30 07:16:38 user nova-compute[75293]: DEBUG nova.compute.manager [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received event network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] Acquiring lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG nova.compute.manager [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] No waiting events found dispatching network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:38 user nova-compute[75293]: WARNING nova.compute.manager [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received unexpected event network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a for instance with vm_state active and task_state rebuilding.
Nov 30 07:16:38 user nova-compute[75293]: DEBUG nova.compute.manager [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received event network-vif-unplugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] Acquiring lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG nova.compute.manager [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] No waiting events found dispatching network-vif-unplugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:38 user nova-compute[75293]: WARNING nova.compute.manager [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received unexpected event network-vif-unplugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a for instance with vm_state active and task_state rebuilding.
Nov 30 07:16:38 user nova-compute[75293]: DEBUG nova.compute.manager [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received event network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] Acquiring lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG nova.compute.manager [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] No waiting events found dispatching network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:38 user nova-compute[75293]: WARNING nova.compute.manager [req-ebd8ed36-6d9c-4067-8586-8b76346ad229 req-56d5716d-b133-47c9-a9a6-34c7d9191f2f service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received unexpected event network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a for instance with vm_state active and task_state rebuilding.
Nov 30 07:16:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG nova.compute.manager [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Preparing to wait for external event volume-reimaged-92ccb270-8b75-445c-b80f-4af3ec1018db {{(pid=75293) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Acquiring lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG nova.compute.manager [req-e2a59365-c3e0-425d-bc20-48560f83e7b5 req-5b657f8a-5ec9-4eba-89c1-30188ab014bf service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Received event network-vif-unplugged-3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e2a59365-c3e0-425d-bc20-48560f83e7b5 req-5b657f8a-5ec9-4eba-89c1-30188ab014bf service nova] Acquiring lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e2a59365-c3e0-425d-bc20-48560f83e7b5 req-5b657f8a-5ec9-4eba-89c1-30188ab014bf service nova] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e2a59365-c3e0-425d-bc20-48560f83e7b5 req-5b657f8a-5ec9-4eba-89c1-30188ab014bf service nova] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG nova.compute.manager [req-e2a59365-c3e0-425d-bc20-48560f83e7b5 req-5b657f8a-5ec9-4eba-89c1-30188ab014bf service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] No waiting events found dispatching network-vif-unplugged-3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG nova.compute.manager [req-e2a59365-c3e0-425d-bc20-48560f83e7b5 req-5b657f8a-5ec9-4eba-89c1-30188ab014bf service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Received event network-vif-unplugged-3d550d68-3322-4126-8dce-9201214e61f8 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:39 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Instance destroyed successfully.
Nov 30 07:16:39 user nova-compute[75293]: DEBUG nova.objects.instance [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lazy-loading 'resources' on Instance uuid 009f70bc-7561-48fe-ba47-ebaf4d81d462 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:16:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T07:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-418067200',display_name='tempest-ServerActionsTestOtherA-server-565212846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-418067200',id=14,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2kLa2wHH9ln/DcE1mMyiHO9XBIKOTjYK22BOzhVHg5r0qn+BLS7JnYCSc645GeKcssQgl8lEq/PAj32RkQGtMjm7fEtz2pN4k+1RJtJOqNOhF7RahDUe4ozMYeynwFmw==',key_name='tempest-keypair-1656097843',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:13:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7d94d0308eb444dbdcd3e5c7c21fe79',ramdisk_id='',reservation_id='r-letc0pyj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1263829597',owner_user_name='tempest-ServerActionsTestOtherA-1263829597-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='917adc7b254e4711ad5f5adbdd2689d4',uuid=009f70bc-7561-48fe-ba47-ebaf4d81d462,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d550d68-3322-4126-8dce-9201214e61f8", "address": "fa:16:3e:79:15:d4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d550d68-33", "ovs_interfaceid": "3d550d68-3322-4126-8dce-9201214e61f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:16:39 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converting VIF {"id": "3d550d68-3322-4126-8dce-9201214e61f8", "address": "fa:16:3e:79:15:d4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d550d68-33", "ovs_interfaceid": "3d550d68-3322-4126-8dce-9201214e61f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:16:39 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:15:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d550d68-3322-4126-8dce-9201214e61f8,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d550d68-33') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:16:39 user nova-compute[75293]: DEBUG os_vif [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:15:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d550d68-3322-4126-8dce-9201214e61f8,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d550d68-33') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:16:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d550d68-33, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:16:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:16:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1faf4cbf-e59f-4b91-a49d-b1ffdec1b85b) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:16:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:16:39 user nova-compute[75293]: INFO os_vif [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:15:d4,bridge_name='br-int',has_traffic_filtering=True,id=3d550d68-3322-4126-8dce-9201214e61f8,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d550d68-33')
Nov 30 07:16:39 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Deleting instance files /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462_del
Nov 30 07:16:39 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Deletion of /opt/stack/data/nova/instances/009f70bc-7561-48fe-ba47-ebaf4d81d462_del complete
Nov 30 07:16:39 user nova-compute[75293]: INFO nova.compute.manager [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 30 07:16:39 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:16:39 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:16:39 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:16:40 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:16:40 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Took 0.92 seconds to deallocate network for instance.
Nov 30 07:16:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:40 user nova-compute[75293]: DEBUG nova.compute.manager [req-4707b235-c14e-4990-ae78-223bcc888dee req-95129c0a-d1d7-4c42-889f-2ff849fc2887 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Received event network-vif-deleted-3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:40 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:16:40 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:16:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:40 user nova-compute[75293]: DEBUG nova.compute.manager [req-d8408308-087b-4620-8da0-e9e7e5095208 req-083e68a4-dcf8-4835-8fd6-9b26b687a442 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Received event network-vif-plugged-3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d8408308-087b-4620-8da0-e9e7e5095208 req-083e68a4-dcf8-4835-8fd6-9b26b687a442 service nova] Acquiring lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d8408308-087b-4620-8da0-e9e7e5095208 req-083e68a4-dcf8-4835-8fd6-9b26b687a442 service nova] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d8408308-087b-4620-8da0-e9e7e5095208 req-083e68a4-dcf8-4835-8fd6-9b26b687a442 service nova] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:40 user nova-compute[75293]: DEBUG nova.compute.manager [req-d8408308-087b-4620-8da0-e9e7e5095208 req-083e68a4-dcf8-4835-8fd6-9b26b687a442 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] No waiting events found dispatching network-vif-plugged-3d550d68-3322-4126-8dce-9201214e61f8 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:16:40 user nova-compute[75293]: WARNING nova.compute.manager [req-d8408308-087b-4620-8da0-e9e7e5095208 req-083e68a4-dcf8-4835-8fd6-9b26b687a442 service nova] [instance: 009f70bc-7561-48fe-ba47-ebaf4d81d462] Received unexpected event network-vif-plugged-3d550d68-3322-4126-8dce-9201214e61f8 for instance with vm_state deleted and task_state None.
Nov 30 07:16:40 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Deleted allocations for instance 009f70bc-7561-48fe-ba47-ebaf4d81d462
Nov 30 07:16:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e0b542a8-2638-46c1-8645-4bc92fa5ebc9 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "009f70bc-7561-48fe-ba47-ebaf4d81d462" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.569s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:48 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:16:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:50 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:16:50 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:16:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:52 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d34f99fc-343e-4e8a-83e6-372b0326bded is timed out.
Nov 30 07:16:52 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Successfully detached device vdb from instance d34f99fc-343e-4e8a-83e6-372b0326bded from the live domain config.
Nov 30 07:16:52 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qygiNSdP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:16:52 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:16:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad991797-78ca-489f-b591-51e650aff8d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:16:52 user nova-compute[75293]: No targets found.
Nov 30 07:16:52 user nova-compute[75293]: iSNS:
Nov 30 07:16:52 user nova-compute[75293]: No targets found.
Nov 30 07:16:52 user nova-compute[75293]: STATIC:
Nov 30 07:16:52 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c
Nov 30 07:16:52 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:16:52 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:16:52 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:16:52 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:16:52 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:16:52 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db
Nov 30 07:16:52 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:16:52 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:16:52 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31
Nov 30 07:16:52 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:16:52 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:16:52 user nova-compute[75293]: FIRMWARE:
Nov 30 07:16:52 user nova-compute[75293]: No targets found.
Nov 30 07:16:52 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:16:52 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:16:52 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[100aa9a0-137b-4cef-835b-c1b9350db5f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8567d0e5-dcff-4bcf-8354-44387f4dfe2f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:16:52 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:16:52 user nova-compute[75293]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 (non-flash)
Nov 30 07:16:52 user nova-compute[75293]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:16:52 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:16:52 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:16:52 user nova-compute[75293]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 (non-flash)
Nov 30 07:16:52 user nova-compute[75293]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:16:52 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effc87bdd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31'): ({'sde'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Removing single pathed devices sde {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ec04c5-f14e-4cdb-9f2c-a1b19c4e39cd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[322f3c4f-0b56-4e42-9ca2-f900a2ec3416]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Flushing IO for device /dev/sde {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2631a5e4-30e5-4377-a3f1-081c4fcbaff7]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c66672-1819-4379-a843-2d5ecdbe14cd]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] SCSI volumes sde have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[156615b0-18e0-4ded-a01f-c071eaf45f82]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[12185e84-4453-4c7a-924d-26924ebda0f4]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31, portal: 172.16.0.220,3260]
Nov 30 07:16:53 user nova-compute[75293]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31, portal: 172.16.0.220,3260] successful.
Nov 30 07:16:53 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c88a46b-c7b8-4748-b168-f240b60a4b31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[355daea6-d2d7-463e-9113-8fc20ae88e1f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] <== disconnect_volume: return (326ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:54 user nova-compute[75293]: DEBUG nova.objects.instance [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lazy-loading 'flavor' on Instance uuid d34f99fc-343e-4e8a-83e6-372b0326bded {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:16:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk --force-share --output=json" returned: 0 in 0.486s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-bcd88a36-831e-4d7f-8cd2-44ce33af5fc6 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "d34f99fc-343e-4e8a-83e6-372b0326bded" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.657s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:16:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:16:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:16:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:16:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:16:56 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:16:56 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:16:56 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=7398MB free_disk=25.12779998779297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:16:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:16:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:16:56 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b7deb0a-39af-4d93-b93d-5765a731f702 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:16:56 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance c8d1df78-2aa2-4710-a570-5f72c60cfc26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:16:56 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9295d423-d71c-436b-9306-e0b386a0011f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:16:56 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance d34f99fc-343e-4e8a-83e6-372b0326bded actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:16:56 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 093deaa6-a68c-4688-9055-69dda63b6b4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:16:56 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 4be43bb1-b17c-40b9-953a-c820f2396176 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:16:56 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 5576f436-247d-461d-9859-f9bb3ee4fa18 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:16:56 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance ed037c80-4f33-4e03-907c-18b4ea122411 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:16:56 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:16:56 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance a46f0c4f-4449-47e2-aa1e-a4508c81d768 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:16:56 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:16:56 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:16:57 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:16:57 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:16:57 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:16:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:16:57 user nova-compute[75293]: DEBUG nova.compute.manager [req-d9192941-6032-4527-ac9c-b95c3ec5b14a req-66d0560d-0af6-42ef-b41e-0e1307a955a3 service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Received event network-changed-3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:16:57 user nova-compute[75293]: DEBUG nova.compute.manager [req-d9192941-6032-4527-ac9c-b95c3ec5b14a req-66d0560d-0af6-42ef-b41e-0e1307a955a3 service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Refreshing instance network info cache due to event network-changed-3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:16:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d9192941-6032-4527-ac9c-b95c3ec5b14a req-66d0560d-0af6-42ef-b41e-0e1307a955a3 service nova] Acquiring lock "refresh_cache-4be43bb1-b17c-40b9-953a-c820f2396176" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:16:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d9192941-6032-4527-ac9c-b95c3ec5b14a req-66d0560d-0af6-42ef-b41e-0e1307a955a3 service nova] Acquired lock "refresh_cache-4be43bb1-b17c-40b9-953a-c820f2396176" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:16:57 user nova-compute[75293]: DEBUG nova.network.neutron [req-d9192941-6032-4527-ac9c-b95c3ec5b14a req-66d0560d-0af6-42ef-b41e-0e1307a955a3 service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Refreshing network info cache for port 3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:16:57 user nova-compute[75293]: DEBUG nova.network.neutron [req-d9192941-6032-4527-ac9c-b95c3ec5b14a req-66d0560d-0af6-42ef-b41e-0e1307a955a3 service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Updated VIF entry in instance network info cache for port 3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:16:57 user nova-compute[75293]: DEBUG nova.network.neutron [req-d9192941-6032-4527-ac9c-b95c3ec5b14a req-66d0560d-0af6-42ef-b41e-0e1307a955a3 service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Updating instance_info_cache with network_info: [{"id": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "address": "fa:16:3e:09:2f:cb", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10da91-4b", "ovs_interfaceid": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:16:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d9192941-6032-4527-ac9c-b95c3ec5b14a req-66d0560d-0af6-42ef-b41e-0e1307a955a3 service nova] Releasing lock "refresh_cache-4be43bb1-b17c-40b9-953a-c820f2396176" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:16:58 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:16:58 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:16:58 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:16:58 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Didn't find any instances for network info cache update. {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 07:16:58 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:16:58 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:16:58 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:16:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "4be43bb1-b17c-40b9-953a-c820f2396176" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "4be43bb1-b17c-40b9-953a-c820f2396176" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG nova.objects.instance [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lazy-loading 'flavor' on Instance uuid 4be43bb1-b17c-40b9-953a-c820f2396176 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "4be43bb1-b17c-40b9-953a-c820f2396176" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "4be43bb1-b17c-40b9-953a-c820f2396176" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "4be43bb1-b17c-40b9-953a-c820f2396176" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:01 user nova-compute[75293]: INFO nova.compute.manager [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Attaching volume 0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 to /dev/vdb
Nov 30 07:17:01 user nova-compute[75293]: DEBUG nova.compute.manager [req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 req-8a909f19-b2b0-469b-864d-d9ad57a78465 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received event volume-reimaged-92ccb270-8b75-445c-b80f-4af3ec1018db {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 req-8a909f19-b2b0-469b-864d-d9ad57a78465 service nova] Acquiring lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 req-8a909f19-b2b0-469b-864d-d9ad57a78465 service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 req-8a909f19-b2b0-469b-864d-d9ad57a78465 service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG nova.compute.manager [req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 req-8a909f19-b2b0-469b-864d-d9ad57a78465 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Processing event volume-reimaged-92ccb270-8b75-445c-b80f-4af3ec1018db {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG nova.compute.manager [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Instance event wait completed in 22 seconds for volume-reimaged {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG os_brick.utils [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e80d98-d3ff-41de-9d4d-146cfd453e4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:01 user nova-compute[75293]: INFO nova.virt.block_device [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Booting with volume 92ccb270-8b75-445c-b80f-4af3ec1018db at /dev/vda
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ebd3c2-6833-45af-877d-51f7afd10c8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff04857b-b57f-453c-9508-fcfa11798789]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7b70dc-6943-439c-b91f-0a459b04ce86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG os_brick.utils [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fc8c36-7570-423f-adcb-7af60fe7ae0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:17:01 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfb9846-e2ba-4498-b03d-496bc796616e]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG os_brick.utils [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Updating existing volume attachment record: 29133f04-3e37-4b86-8193-78949f131e67 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5e3242-717e-4a80-ac11-3b211f6cdf52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31f2e4e-6607-4b78-9dcd-9ab1e177d0ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e79086-bc58-49ed-b81c-d59250966443]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:17:01 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:17:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecddb6a0-ae72-43ae-8519-2c1de28e9fbe]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG os_brick.utils [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:17:01 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Updating existing volume attachment record: 51b987b2-2d2f-4766-9674-0658ac093484 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:17:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquiring lock "5576f436-247d-461d-9859-f9bb3ee4fa18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "5576f436-247d-461d-9859-f9bb3ee4fa18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquiring lock "5576f436-247d-461d-9859-f9bb3ee4fa18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "5576f436-247d-461d-9859-f9bb3ee4fa18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "5576f436-247d-461d-9859-f9bb3ee4fa18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:04 user nova-compute[75293]: INFO nova.compute.manager [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Terminating instance
Nov 30 07:17:04 user nova-compute[75293]: DEBUG nova.compute.manager [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:17:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-a9d7188a-6261-4f3b-83c8-368ebbc1fc01 req-9a1d340e-b14b-45cc-bdaf-25f04604028f service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Received event network-vif-unplugged-74083f81-5c90-4bbb-a53d-4e910a926b42 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a9d7188a-6261-4f3b-83c8-368ebbc1fc01 req-9a1d340e-b14b-45cc-bdaf-25f04604028f service nova] Acquiring lock "5576f436-247d-461d-9859-f9bb3ee4fa18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a9d7188a-6261-4f3b-83c8-368ebbc1fc01 req-9a1d340e-b14b-45cc-bdaf-25f04604028f service nova] Lock "5576f436-247d-461d-9859-f9bb3ee4fa18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a9d7188a-6261-4f3b-83c8-368ebbc1fc01 req-9a1d340e-b14b-45cc-bdaf-25f04604028f service nova] Lock "5576f436-247d-461d-9859-f9bb3ee4fa18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-a9d7188a-6261-4f3b-83c8-368ebbc1fc01 req-9a1d340e-b14b-45cc-bdaf-25f04604028f service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] No waiting events found dispatching network-vif-unplugged-74083f81-5c90-4bbb-a53d-4e910a926b42 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:17:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-a9d7188a-6261-4f3b-83c8-368ebbc1fc01 req-9a1d340e-b14b-45cc-bdaf-25f04604028f service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Received event network-vif-unplugged-74083f81-5c90-4bbb-a53d-4e910a926b42 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:17:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:05 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Instance destroyed successfully.
Nov 30 07:17:05 user nova-compute[75293]: DEBUG nova.objects.instance [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lazy-loading 'resources' on Instance uuid 5576f436-247d-461d-9859-f9bb3ee4fa18 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:17:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:15:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-571287958',display_name='tempest-VolumesActionsTest-instance-571287958',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-571287958',id=24,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:15:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='379a38913c014e62b5b0256318c92dd8',ramdisk_id='',reservation_id='r-hi5b53ri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2065132499',owner_user_name='tempest-VolumesActionsTest-2065132499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:15:22Z,user_data=None,user_id='09ce91e4a92b4ee9acd2c4c9929574ff',uuid=5576f436-247d-461d-9859-f9bb3ee4fa18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74083f81-5c90-4bbb-a53d-4e910a926b42", "address": "fa:16:3e:59:9c:33", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74083f81-5c", "ovs_interfaceid": "74083f81-5c90-4bbb-a53d-4e910a926b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:17:05 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Converting VIF {"id": "74083f81-5c90-4bbb-a53d-4e910a926b42", "address": "fa:16:3e:59:9c:33", "network": {"id": "9d47d272-ffeb-4f6c-9246-2acefdf615a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1926859270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "379a38913c014e62b5b0256318c92dd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74083f81-5c", "ovs_interfaceid": "74083f81-5c90-4bbb-a53d-4e910a926b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:17:05 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:9c:33,bridge_name='br-int',has_traffic_filtering=True,id=74083f81-5c90-4bbb-a53d-4e910a926b42,network=Network(9d47d272-ffeb-4f6c-9246-2acefdf615a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74083f81-5c') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:17:05 user nova-compute[75293]: DEBUG os_vif [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:9c:33,bridge_name='br-int',has_traffic_filtering=True,id=74083f81-5c90-4bbb-a53d-4e910a926b42,network=Network(9d47d272-ffeb-4f6c-9246-2acefdf615a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74083f81-5c') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:17:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74083f81-5c, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:17:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb46b1cc-5844-4fe2-a1a0-451e0d14284a) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:05 user nova-compute[75293]: INFO os_vif [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:9c:33,bridge_name='br-int',has_traffic_filtering=True,id=74083f81-5c90-4bbb-a53d-4e910a926b42,network=Network(9d47d272-ffeb-4f6c-9246-2acefdf615a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74083f81-5c')
Nov 30 07:17:05 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Deleting instance files /opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18_del
Nov 30 07:17:05 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Deletion of /opt/stack/data/nova/instances/5576f436-247d-461d-9859-f9bb3ee4fa18_del complete
Nov 30 07:17:05 user nova-compute[75293]: INFO nova.compute.manager [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 30 07:17:05 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:17:05 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:17:05 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:17:05 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:17:05 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Took 0.65 seconds to deallocate network for instance.
Nov 30 07:17:05 user nova-compute[75293]: DEBUG nova.compute.manager [req-5413333b-fe1e-438f-8335-9f179d78f07e req-c956d9e5-d9ca-491c-8b58-a49d15ccb7dc service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Received event network-vif-deleted-74083f81-5c90-4bbb-a53d-4e910a926b42 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:05 user nova-compute[75293]: INFO nova.compute.manager [req-5413333b-fe1e-438f-8335-9f179d78f07e req-c956d9e5-d9ca-491c-8b58-a49d15ccb7dc service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Neutron deleted interface 74083f81-5c90-4bbb-a53d-4e910a926b42; detaching it from the instance and deleting it from the info cache
Nov 30 07:17:05 user nova-compute[75293]: DEBUG nova.network.neutron [req-5413333b-fe1e-438f-8335-9f179d78f07e req-c956d9e5-d9ca-491c-8b58-a49d15ccb7dc service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:17:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-5413333b-fe1e-438f-8335-9f179d78f07e req-c956d9e5-d9ca-491c-8b58-a49d15ccb7dc service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Detach interface failed, port_id=74083f81-5c90-4bbb-a53d-4e910a926b42, reason: Instance 5576f436-247d-461d-9859-f9bb3ee4fa18 could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:17:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:06 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:17:06 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:17:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:06 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Deleted allocations for instance 5576f436-247d-461d-9859-f9bb3ee4fa18
Nov 30 07:17:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-86f2583a-48d1-48a7-9bf9-84a357443e05 tempest-VolumesActionsTest-2065132499 tempest-VolumesActionsTest-2065132499-project-member] Lock "5576f436-247d-461d-9859-f9bb3ee4fa18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.144s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-05b75b27-5f5b-4728-827e-764c7c867436 req-0e966671-8ee8-42ed-8774-bf6d29bcf7a7 service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Received event network-vif-plugged-74083f81-5c90-4bbb-a53d-4e910a926b42 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-05b75b27-5f5b-4728-827e-764c7c867436 req-0e966671-8ee8-42ed-8774-bf6d29bcf7a7 service nova] Acquiring lock "5576f436-247d-461d-9859-f9bb3ee4fa18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-05b75b27-5f5b-4728-827e-764c7c867436 req-0e966671-8ee8-42ed-8774-bf6d29bcf7a7 service nova] Lock "5576f436-247d-461d-9859-f9bb3ee4fa18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-05b75b27-5f5b-4728-827e-764c7c867436 req-0e966671-8ee8-42ed-8774-bf6d29bcf7a7 service nova] Lock "5576f436-247d-461d-9859-f9bb3ee4fa18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-05b75b27-5f5b-4728-827e-764c7c867436 req-0e966671-8ee8-42ed-8774-bf6d29bcf7a7 service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] No waiting events found dispatching network-vif-plugged-74083f81-5c90-4bbb-a53d-4e910a926b42 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:17:06 user nova-compute[75293]: WARNING nova.compute.manager [req-05b75b27-5f5b-4728-827e-764c7c867436 req-0e966671-8ee8-42ed-8774-bf6d29bcf7a7 service nova] [instance: 5576f436-247d-461d-9859-f9bb3ee4fa18] Received unexpected event network-vif-plugged-74083f81-5c90-4bbb-a53d-4e910a926b42 for instance with vm_state deleted and task_state None.
Nov 30 07:17:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:17:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75293) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 07:17:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:17:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:17:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquiring lock "821af6a7-0ab8-4947-afaf-e97b2b781375" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "821af6a7-0ab8-4947-afaf-e97b2b781375" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:16 user nova-compute[75293]: DEBUG nova.compute.manager [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:17:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:16 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:17:16 user nova-compute[75293]: INFO nova.compute.claims [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Claim successful on node user
Nov 30 07:17:16 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:17:16 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:17:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:16 user nova-compute[75293]: DEBUG nova.compute.manager [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:17:16 user nova-compute[75293]: DEBUG nova.compute.manager [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:17:16 user nova-compute[75293]: DEBUG nova.network.neutron [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:17:16 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:17:16 user nova-compute[75293]: DEBUG nova.compute.manager [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:17:16 user nova-compute[75293]: DEBUG nova.compute.manager [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:17:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:17:16 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Creating image(s)
Nov 30 07:17:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquiring lock "/opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "/opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "/opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:16 user nova-compute[75293]: DEBUG nova.policy [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f04441af417245e2a68e11d52ad7b05f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744f39a1f6d424fa13d77ed2ced51c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.177s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.169s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/disk 1073741824" returned: 0 in 0.052s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.network.neutron [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Successfully created port: cc58bfc6-9bcd-41e7-aa0c-b14c293440e3 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.195s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Checking if we can resize image /opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PQrijLIS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:17:17 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:17:17 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:17:17 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Cannot resize image /opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Ensure instance console log exists: /opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea05344-3c59-4b30-8ad1-40dbab6e8da7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:17:17 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1545134e-8b38-42f1-a716-dfa79a655ead]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0] added
Nov 30 07:17:17 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffcd393-e23c-48c8-949e-8aa63ec0f615]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cf7ed9-9195-4d40-b29b-767debcd5bbf]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PQrijLIS {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PQrijLIS" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f485f757-0ee5-4577-b3ab-e89bea163757]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PQrijLIS'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d363bbf5-00fe-42d5-8518-a4b06d3e0857]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e60a1ca-0da4-4ede-9203-dc9b09970d40]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:17:17 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:17:17 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:17:17 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:17:17 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:17:17 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Creating image(s)
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Did not create local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Ensure instance console log exists: /opt/stack/data/nova/instances/093deaa6-a68c-4688-9055-69dda63b6b4c/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Start _get_guest_xml network_info=[{"id": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "address": "fa:16:3e:e7:42:bf", "network": {"id": "1c0cc61f-f779-4846-a964-db0ac1ed358a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1209595465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b1b51e818e442ab5d4b68fede61c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b984e7-f1", "ovs_interfaceid": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyFrHfeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '093deaa6-a68c-4688-9055-69dda63b6b4c', 'attached_at': '', 'detached_at': '', 'volume_id': '92ccb270-8b75-445c-b80f-4af3ec1018db', 'serial': '92ccb270-8b75-445c-b80f-4af3ec1018db'}, 'delete_on_termination': True, 'attachment_id': '51b987b2-2d2f-4766-9674-0658ac093484', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:17:17 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 07:17:17 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.objects.instance [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lazy-loading 'vcpu_model' on Instance uuid 093deaa6-a68c-4688-9055-69dda63b6b4c {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyFrHfeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:17:17 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef994e3-ed02-43f5-b314-ace18cbc5f74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0, portal: 172.16.0.220,3260]
Nov 30 07:17:17 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0, portal: 172.16.0.220,3260] successful.
Nov 30 07:17:17 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.048s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5fde2e-20ef-4d6f-8596-f0edf1d4d193]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[234e35de-010b-4bd5-b663-b1a58a6cf427]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:17:17 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:17:17 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:17:17 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:17:17 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:17:17 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:17:17 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:17:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1237f6dd-00cd-48e4-b4f2-f9a2239447f3]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PQrijLIS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.network.neutron [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Successfully updated port: cc58bfc6-9bcd-41e7-aa0c-b14c293440e3 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquiring lock "refresh_cache-821af6a7-0ab8-4947-afaf-e97b2b781375" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquired lock "refresh_cache-821af6a7-0ab8-4947-afaf-e97b2b781375" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.network.neutron [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.network.neutron [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.compute.manager [req-6a3fd266-9b06-48e5-9b4a-cae60f708e60 req-93e5e775-179b-4c97-bd59-d996d6900a1c service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Received event network-changed-cc58bfc6-9bcd-41e7-aa0c-b14c293440e3 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.compute.manager [req-6a3fd266-9b06-48e5-9b4a-cae60f708e60 req-93e5e775-179b-4c97-bd59-d996d6900a1c service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Refreshing instance network info cache due to event network-changed-cc58bfc6-9bcd-41e7-aa0c-b14c293440e3. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6a3fd266-9b06-48e5-9b4a-cae60f708e60 req-93e5e775-179b-4c97-bd59-d996d6900a1c service nova] Acquiring lock "refresh_cache-821af6a7-0ab8-4947-afaf-e97b2b781375" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.network.neutron [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Updating instance_info_cache with network_info: [{"id": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "address": "fa:16:3e:84:bd:f7", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc58bfc6-9b", "ovs_interfaceid": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Releasing lock "refresh_cache-821af6a7-0ab8-4947-afaf-e97b2b781375" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.compute.manager [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Instance network_info: |[{"id": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "address": "fa:16:3e:84:bd:f7", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc58bfc6-9b", "ovs_interfaceid": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6a3fd266-9b06-48e5-9b4a-cae60f708e60 req-93e5e775-179b-4c97-bd59-d996d6900a1c service nova] Acquired lock "refresh_cache-821af6a7-0ab8-4947-afaf-e97b2b781375" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.network.neutron [req-6a3fd266-9b06-48e5-9b4a-cae60f708e60 req-93e5e775-179b-4c97-bd59-d996d6900a1c service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Refreshing network info cache for port cc58bfc6-9bcd-41e7-aa0c-b14c293440e3 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Start _get_guest_xml network_info=[{"id": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "address": "fa:16:3e:84:bd:f7", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc58bfc6-9b", "ovs_interfaceid": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:17:18 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:17:18 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-897528997',display_name='tempest-ServersNegativeTestJSON-server-897528997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-897528997',id=28,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8744f39a1f6d424fa13d77ed2ced51c5',ramdisk_id='',reservation_id='r-rmcib07y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1767090220',owner_user_name='tempest-ServersNegativeTestJSON-1767090220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:17:17Z,user_data=None,user_id='f04441af417245e2a68e11d52ad7b05f',uuid=821af6a7-0ab8-4947-afaf-e97b2b781375,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "address": "fa:16:3e:84:bd:f7", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc58bfc6-9b", "ovs_interfaceid": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Converting VIF {"id": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "address": "fa:16:3e:84:bd:f7", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc58bfc6-9b", "ovs_interfaceid": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:bd:f7,bridge_name='br-int',has_traffic_filtering=True,id=cc58bfc6-9bcd-41e7-aa0c-b14c293440e3,network=Network(f557522c-aed7-4965-8036-cb4260a19168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc58bfc6-9b') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.objects.instance [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lazy-loading 'pci_devices' on Instance uuid 821af6a7-0ab8-4947-afaf-e97b2b781375 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:17:18 user nova-compute[75293]:   <uuid>821af6a7-0ab8-4947-afaf-e97b2b781375</uuid>
Nov 30 07:17:18 user nova-compute[75293]:   <name>instance-0000001c</name>
Nov 30 07:17:18 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:17:18 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:17:18 user nova-compute[75293]:   <metadata>
Nov 30 07:17:18 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:17:18 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:17:18 user nova-compute[75293]:       <nova:name>tempest-ServersNegativeTestJSON-server-897528997</nova:name>
Nov 30 07:17:18 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:17:18</nova:creationTime>
Nov 30 07:17:18 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:17:18 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:17:18 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:17:18 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:17:18 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:17:18 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:17:18 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:17:18 user nova-compute[75293]:       <nova:owner>
Nov 30 07:17:18 user nova-compute[75293]:         <nova:user uuid="f04441af417245e2a68e11d52ad7b05f">tempest-ServersNegativeTestJSON-1767090220-project-member</nova:user>
Nov 30 07:17:18 user nova-compute[75293]:         <nova:project uuid="8744f39a1f6d424fa13d77ed2ced51c5">tempest-ServersNegativeTestJSON-1767090220</nova:project>
Nov 30 07:17:18 user nova-compute[75293]:       </nova:owner>
Nov 30 07:17:18 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:17:18 user nova-compute[75293]:       <nova:ports>
Nov 30 07:17:18 user nova-compute[75293]:         <nova:port uuid="cc58bfc6-9bcd-41e7-aa0c-b14c293440e3">
Nov 30 07:17:18 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 07:17:18 user nova-compute[75293]:         </nova:port>
Nov 30 07:17:18 user nova-compute[75293]:       </nova:ports>
Nov 30 07:17:18 user nova-compute[75293]:     </nova:instance>
Nov 30 07:17:18 user nova-compute[75293]:   </metadata>
Nov 30 07:17:18 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:17:18 user nova-compute[75293]:     <system>
Nov 30 07:17:18 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:17:18 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:17:18 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:17:18 user nova-compute[75293]:       <entry name="serial">821af6a7-0ab8-4947-afaf-e97b2b781375</entry>
Nov 30 07:17:18 user nova-compute[75293]:       <entry name="uuid">821af6a7-0ab8-4947-afaf-e97b2b781375</entry>
Nov 30 07:17:18 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:17:18 user nova-compute[75293]:     </system>
Nov 30 07:17:18 user nova-compute[75293]:   </sysinfo>
Nov 30 07:17:18 user nova-compute[75293]:   <os>
Nov 30 07:17:18 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:17:18 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:17:18 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:17:18 user nova-compute[75293]:   </os>
Nov 30 07:17:18 user nova-compute[75293]:   <features>
Nov 30 07:17:18 user nova-compute[75293]:     <acpi/>
Nov 30 07:17:18 user nova-compute[75293]:     <apic/>
Nov 30 07:17:18 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:17:18 user nova-compute[75293]:   </features>
Nov 30 07:17:18 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:17:18 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:17:18 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:17:18 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:17:18 user nova-compute[75293]:   </clock>
Nov 30 07:17:18 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:17:18 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:17:18 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:17:18 user nova-compute[75293]:   </cpu>
Nov 30 07:17:18 user nova-compute[75293]:   <devices>
Nov 30 07:17:18 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:17:18 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:17:18 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/disk"/>
Nov 30 07:17:18 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:17:18 user nova-compute[75293]:     </disk>
Nov 30 07:17:18 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:17:18 user nova-compute[75293]:       <mac address="fa:16:3e:84:bd:f7"/>
Nov 30 07:17:18 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:17:18 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:17:18 user nova-compute[75293]:       <target dev="tapcc58bfc6-9b"/>
Nov 30 07:17:18 user nova-compute[75293]:     </interface>
Nov 30 07:17:18 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:17:18 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/console.log" append="off"/>
Nov 30 07:17:18 user nova-compute[75293]:     </serial>
Nov 30 07:17:18 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:17:18 user nova-compute[75293]:     <video>
Nov 30 07:17:18 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:17:18 user nova-compute[75293]:     </video>
Nov 30 07:17:18 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:17:18 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:17:18 user nova-compute[75293]:     </rng>
Nov 30 07:17:18 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:17:18 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:17:18 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:17:18 user nova-compute[75293]:     </memballoon>
Nov 30 07:17:18 user nova-compute[75293]:   </devices>
Nov 30 07:17:18 user nova-compute[75293]: </domain>
Nov 30 07:17:18 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-897528997',display_name='tempest-ServersNegativeTestJSON-server-897528997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-897528997',id=28,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8744f39a1f6d424fa13d77ed2ced51c5',ramdisk_id='',reservation_id='r-rmcib07y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1767090220',owner_user_name='tempest-ServersNegativeTestJSON-1767090220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:17:17Z,user_data=None,user_id='f04441af417245e2a68e11d52ad7b05f',uuid=821af6a7-0ab8-4947-afaf-e97b2b781375,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "address": "fa:16:3e:84:bd:f7", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc58bfc6-9b", "ovs_interfaceid": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Converting VIF {"id": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "address": "fa:16:3e:84:bd:f7", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc58bfc6-9b", "ovs_interfaceid": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:bd:f7,bridge_name='br-int',has_traffic_filtering=True,id=cc58bfc6-9bcd-41e7-aa0c-b14c293440e3,network=Network(f557522c-aed7-4965-8036-cb4260a19168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc58bfc6-9b') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG os_vif [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:bd:f7,bridge_name='br-int',has_traffic_filtering=True,id=cc58bfc6-9bcd-41e7-aa0c-b14c293440e3,network=Network(f557522c-aed7-4965-8036-cb4260a19168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc58bfc6-9b') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1ed89e8-816c-593b-a576-1c2b3e6e53f2', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc58bfc6-9b, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc58bfc6-9b, col_values=(('qos', UUID('7ee9937e-e81b-4339-92b1-c36964eb19bf')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc58bfc6-9b, col_values=(('external_ids', {'iface-id': 'cc58bfc6-9bcd-41e7-aa0c-b14c293440e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:bd:f7', 'vm-uuid': '821af6a7-0ab8-4947-afaf-e97b2b781375'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:18 user nova-compute[75293]: INFO nova.compute.manager [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Rescuing
Nov 30 07:17:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "refresh_cache-9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquired lock "refresh_cache-9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG nova.network.neutron [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:17:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:18 user nova-compute[75293]: INFO os_vif [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:bd:f7,bridge_name='br-int',has_traffic_filtering=True,id=cc58bfc6-9bcd-41e7-aa0c-b14c293440e3,network=Network(f557522c-aed7-4965-8036-cb4260a19168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc58bfc6-9b')
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '26630383136353233', 'path': '/dev/sdc'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630383136353233', 'path': '/dev/sdc'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.109s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:17:19 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:17:19 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[160aee96-0013-4bdd-9a8d-01994e0d3dd9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:17:19 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG nova.objects.instance [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lazy-loading 'flavor' on Instance uuid 4be43bb1-b17c-40b9-953a-c820f2396176 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b59d16d-ef77-4588-9dba-ee51f3a99128]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db] added
Nov 30 07:17:19 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca5de19-1278-4a22-8fb6-84bd65061839]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:17:19 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:17:19 user nova-compute[75293]:   <source dev="/dev/sdc"/>
Nov 30 07:17:19 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:17:19 user nova-compute[75293]:   <serial>0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0</serial>
Nov 30 07:17:19 user nova-compute[75293]: </disk>
Nov 30 07:17:19 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] No VIF found with MAC fa:16:3e:84:bd:f7, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b54f37-65d7-4356-b6c0-158cd21002cc]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tyFrHfeI {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tyFrHfeI" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[af981a36-b63e-4164-8003-4f65e2681d1c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tyFrHfeI'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0a8c73-3d5c-4526-9457-3426892262b8]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ab0290-9c07-4765-bde5-ee53ff6b9f18]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:17:19 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:17:19 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:17:19 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:17:19 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:17:19 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:17:19 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0435335a-3062-40ff-bdd8-01d663764236]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db, portal: 172.16.0.220,3260]
Nov 30 07:17:19 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db, portal: 172.16.0.220,3260] successful.
Nov 30 07:17:19 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6b248a-83a9-4b3c-9002-944e10a6d11f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ee7075-2c75-467d-a9fa-e410b6742f68]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:17:19 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:17:19 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:17:19 user nova-compute[75293]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:17:19 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:17:19 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:17:19 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:17:19 user nova-compute[75293]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:17:19 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b60afb5-e993-4925-af5c-ee9a30447073]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyFrHfeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG nova.network.neutron [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Updating instance_info_cache with network_info: [{"id": "094f0848-c129-4499-8781-6943982188b6", "address": "fa:16:3e:44:2f:52", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094f0848-c1", "ovs_interfaceid": "094f0848-c129-4499-8781-6943982188b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Releasing lock "refresh_cache-9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG nova.network.neutron [req-6a3fd266-9b06-48e5-9b4a-cae60f708e60 req-93e5e775-179b-4c97-bd59-d996d6900a1c service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Updated VIF entry in instance network info cache for port cc58bfc6-9bcd-41e7-aa0c-b14c293440e3. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG nova.network.neutron [req-6a3fd266-9b06-48e5-9b4a-cae60f708e60 req-93e5e775-179b-4c97-bd59-d996d6900a1c service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Updating instance_info_cache with network_info: [{"id": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "address": "fa:16:3e:84:bd:f7", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc58bfc6-9b", "ovs_interfaceid": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6a3fd266-9b06-48e5-9b4a-cae60f708e60 req-93e5e775-179b-4c97-bd59-d996d6900a1c service nova] Releasing lock "refresh_cache-821af6a7-0ab8-4947-afaf-e97b2b781375" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] No VIF found with MAC fa:16:3e:09:2f:cb, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:17:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f4811caa-fff3-4520-be6e-bfa91a195562 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "4be43bb1-b17c-40b9-953a-c820f2396176" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.822s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] <== connect_volume: return (2428ms) {'type': 'block', 'scsi_wwn': '26130633766326663', 'path': '/dev/sde'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130633766326663', 'path': '/dev/sde'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T07:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1257820242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1383728389',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkH/W6LW/O9P0TOjpBNyg9mPCr0F5RhJ5UC+vXQMDgOyUkNDLXMoQER4Pxz+57oxrldBInLqlDI69s4mUYzIevfjGRYjiPK6uYw3Yx4XEko0at9i+vwqVvb+4cGOb36ig==',key_name='tempest-keypair-558954396',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:15:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='30b1b51e818e442ab5d4b68fede61c3b',ramdisk_id='',reservation_id='r-1o3nhquy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-766996460',owner_user_name='tempest-ServerActionsV293TestJSON-766996460-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:17:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9359a918c1394350baf3814eac14c8f6',uuid=093deaa6-a68c-4688-9055-69dda63b6b4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "address": "fa:16:3e:e7:42:bf", "network": {"id": "1c0cc61f-f779-4846-a964-db0ac1ed358a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1209595465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b1b51e818e442ab5d4b68fede61c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b984e7-f1", "ovs_interfaceid": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Converting VIF {"id": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "address": "fa:16:3e:e7:42:bf", "network": {"id": "1c0cc61f-f779-4846-a964-db0ac1ed358a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1209595465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b1b51e818e442ab5d4b68fede61c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b984e7-f1", "ovs_interfaceid": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:42:bf,bridge_name='br-int',has_traffic_filtering=True,id=23b984e7-f18d-4c93-9720-0184ff3d6e0a,network=Network(1c0cc61f-f779-4846-a964-db0ac1ed358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b984e7-f1') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:17:20 user nova-compute[75293]:   <uuid>093deaa6-a68c-4688-9055-69dda63b6b4c</uuid>
Nov 30 07:17:20 user nova-compute[75293]:   <name>instance-00000016</name>
Nov 30 07:17:20 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:17:20 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:17:20 user nova-compute[75293]:   <metadata>
Nov 30 07:17:20 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:17:20 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:17:20 user nova-compute[75293]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1257820242</nova:name>
Nov 30 07:17:20 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:17:17</nova:creationTime>
Nov 30 07:17:20 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:17:20 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:17:20 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:17:20 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:17:20 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:17:20 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:17:20 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:17:20 user nova-compute[75293]:       <nova:owner>
Nov 30 07:17:20 user nova-compute[75293]:         <nova:user uuid="9359a918c1394350baf3814eac14c8f6">tempest-ServerActionsV293TestJSON-766996460-project-member</nova:user>
Nov 30 07:17:20 user nova-compute[75293]:         <nova:project uuid="30b1b51e818e442ab5d4b68fede61c3b">tempest-ServerActionsV293TestJSON-766996460</nova:project>
Nov 30 07:17:20 user nova-compute[75293]:       </nova:owner>
Nov 30 07:17:20 user nova-compute[75293]:       <nova:ports>
Nov 30 07:17:20 user nova-compute[75293]:         <nova:port uuid="23b984e7-f18d-4c93-9720-0184ff3d6e0a">
Nov 30 07:17:20 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 07:17:20 user nova-compute[75293]:         </nova:port>
Nov 30 07:17:20 user nova-compute[75293]:       </nova:ports>
Nov 30 07:17:20 user nova-compute[75293]:     </nova:instance>
Nov 30 07:17:20 user nova-compute[75293]:   </metadata>
Nov 30 07:17:20 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:17:20 user nova-compute[75293]:     <system>
Nov 30 07:17:20 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:17:20 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:17:20 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:17:20 user nova-compute[75293]:       <entry name="serial">093deaa6-a68c-4688-9055-69dda63b6b4c</entry>
Nov 30 07:17:20 user nova-compute[75293]:       <entry name="uuid">093deaa6-a68c-4688-9055-69dda63b6b4c</entry>
Nov 30 07:17:20 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:17:20 user nova-compute[75293]:     </system>
Nov 30 07:17:20 user nova-compute[75293]:   </sysinfo>
Nov 30 07:17:20 user nova-compute[75293]:   <os>
Nov 30 07:17:20 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:17:20 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:17:20 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:17:20 user nova-compute[75293]:   </os>
Nov 30 07:17:20 user nova-compute[75293]:   <features>
Nov 30 07:17:20 user nova-compute[75293]:     <acpi/>
Nov 30 07:17:20 user nova-compute[75293]:     <apic/>
Nov 30 07:17:20 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:17:20 user nova-compute[75293]:   </features>
Nov 30 07:17:20 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:17:20 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:17:20 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:17:20 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:17:20 user nova-compute[75293]:   </clock>
Nov 30 07:17:20 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:17:20 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:17:20 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:17:20 user nova-compute[75293]:   </cpu>
Nov 30 07:17:20 user nova-compute[75293]:   <devices>
Nov 30 07:17:20 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:17:20 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:17:20 user nova-compute[75293]:       <source dev="/dev/sde"/>
Nov 30 07:17:20 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:17:20 user nova-compute[75293]:       <serial>92ccb270-8b75-445c-b80f-4af3ec1018db</serial>
Nov 30 07:17:20 user nova-compute[75293]:     </disk>
Nov 30 07:17:20 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:17:20 user nova-compute[75293]:       <mac address="fa:16:3e:e7:42:bf"/>
Nov 30 07:17:20 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:17:20 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:17:20 user nova-compute[75293]:       <target dev="tap23b984e7-f1"/>
Nov 30 07:17:20 user nova-compute[75293]:     </interface>
Nov 30 07:17:20 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:17:20 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/093deaa6-a68c-4688-9055-69dda63b6b4c/console.log" append="off"/>
Nov 30 07:17:20 user nova-compute[75293]:     </serial>
Nov 30 07:17:20 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:17:20 user nova-compute[75293]:     <video>
Nov 30 07:17:20 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:17:20 user nova-compute[75293]:     </video>
Nov 30 07:17:20 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:17:20 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:17:20 user nova-compute[75293]:     </rng>
Nov 30 07:17:20 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:17:20 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:17:20 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:17:20 user nova-compute[75293]:     </memballoon>
Nov 30 07:17:20 user nova-compute[75293]:   </devices>
Nov 30 07:17:20 user nova-compute[75293]: </domain>
Nov 30 07:17:20 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T07:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1257820242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1383728389',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkH/W6LW/O9P0TOjpBNyg9mPCr0F5RhJ5UC+vXQMDgOyUkNDLXMoQER4Pxz+57oxrldBInLqlDI69s4mUYzIevfjGRYjiPK6uYw3Yx4XEko0at9i+vwqVvb+4cGOb36ig==',key_name='tempest-keypair-558954396',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:15:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='30b1b51e818e442ab5d4b68fede61c3b',ramdisk_id='',reservation_id='r-1o3nhquy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-766996460',owner_user_name='tempest-ServerActionsV293TestJSON-766996460-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:17:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9359a918c1394350baf3814eac14c8f6',uuid=093deaa6-a68c-4688-9055-69dda63b6b4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "address": "fa:16:3e:e7:42:bf", "network": {"id": "1c0cc61f-f779-4846-a964-db0ac1ed358a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1209595465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b1b51e818e442ab5d4b68fede61c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b984e7-f1", "ovs_interfaceid": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Converting VIF {"id": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "address": "fa:16:3e:e7:42:bf", "network": {"id": "1c0cc61f-f779-4846-a964-db0ac1ed358a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1209595465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b1b51e818e442ab5d4b68fede61c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b984e7-f1", "ovs_interfaceid": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:42:bf,bridge_name='br-int',has_traffic_filtering=True,id=23b984e7-f18d-4c93-9720-0184ff3d6e0a,network=Network(1c0cc61f-f779-4846-a964-db0ac1ed358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b984e7-f1') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG os_vif [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:42:bf,bridge_name='br-int',has_traffic_filtering=True,id=23b984e7-f18d-4c93-9720-0184ff3d6e0a,network=Network(1c0cc61f-f779-4846-a964-db0ac1ed358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b984e7-f1') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79cbfa55-8c16-5ab7-9181-3a7d04f478d5', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23b984e7-f1, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23b984e7-f1, col_values=(('qos', UUID('371082c8-f5b7-4635-8aa9-2cfd5ee314e1')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23b984e7-f1, col_values=(('external_ids', {'iface-id': '23b984e7-f18d-4c93-9720-0184ff3d6e0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:42:bf', 'vm-uuid': '093deaa6-a68c-4688-9055-69dda63b6b4c'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:20 user nova-compute[75293]: INFO os_vif [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:42:bf,bridge_name='br-int',has_traffic_filtering=True,id=23b984e7-f18d-4c93-9720-0184ff3d6e0a,network=Network(1c0cc61f-f779-4846-a964-db0ac1ed358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b984e7-f1')
Nov 30 07:17:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] No VIF found with MAC fa:16:3e:e7:42:bf, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-1b3d8d89-0a3f-434f-8b58-3dcb1f2009bf req-2803ae06-d28e-4dc8-9d7a-1d9780ea7701 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received event network-vif-unplugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1b3d8d89-0a3f-434f-8b58-3dcb1f2009bf req-2803ae06-d28e-4dc8-9d7a-1d9780ea7701 service nova] Acquiring lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1b3d8d89-0a3f-434f-8b58-3dcb1f2009bf req-2803ae06-d28e-4dc8-9d7a-1d9780ea7701 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1b3d8d89-0a3f-434f-8b58-3dcb1f2009bf req-2803ae06-d28e-4dc8-9d7a-1d9780ea7701 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-1b3d8d89-0a3f-434f-8b58-3dcb1f2009bf req-2803ae06-d28e-4dc8-9d7a-1d9780ea7701 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] No waiting events found dispatching network-vif-unplugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:17:20 user nova-compute[75293]: WARNING nova.compute.manager [req-1b3d8d89-0a3f-434f-8b58-3dcb1f2009bf req-2803ae06-d28e-4dc8-9d7a-1d9780ea7701 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received unexpected event network-vif-unplugged-094f0848-c129-4499-8781-6943982188b6 for instance with vm_state active and task_state rescuing.
Nov 30 07:17:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-1b3d8d89-0a3f-434f-8b58-3dcb1f2009bf req-2803ae06-d28e-4dc8-9d7a-1d9780ea7701 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received event network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1b3d8d89-0a3f-434f-8b58-3dcb1f2009bf req-2803ae06-d28e-4dc8-9d7a-1d9780ea7701 service nova] Acquiring lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1b3d8d89-0a3f-434f-8b58-3dcb1f2009bf req-2803ae06-d28e-4dc8-9d7a-1d9780ea7701 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1b3d8d89-0a3f-434f-8b58-3dcb1f2009bf req-2803ae06-d28e-4dc8-9d7a-1d9780ea7701 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-1b3d8d89-0a3f-434f-8b58-3dcb1f2009bf req-2803ae06-d28e-4dc8-9d7a-1d9780ea7701 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] No waiting events found dispatching network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:17:20 user nova-compute[75293]: WARNING nova.compute.manager [req-1b3d8d89-0a3f-434f-8b58-3dcb1f2009bf req-2803ae06-d28e-4dc8-9d7a-1d9780ea7701 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received unexpected event network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 for instance with vm_state active and task_state rescuing.
Nov 30 07:17:21 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Instance destroyed successfully.
Nov 30 07:17:21 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Attempting a stable device rescue
Nov 30 07:17:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75293) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 07:17:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Instance directory exists: not creating {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 07:17:21 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Creating image(s)
Nov 30 07:17:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b9424a3-3053-4b8f-9eb9-5c81944a8fd5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "/opt/stack/data/nova/instances/9b9424a3-3053-4b8f-9eb9-5c81944a8fd5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "/opt/stack/data/nova/instances/9b9424a3-3053-4b8f-9eb9-5c81944a8fd5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:21 user nova-compute[75293]: DEBUG nova.objects.instance [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:17:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "197df0a528a707a30d8931883ae7b2d43f69bf1c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "197df0a528a707a30d8931883ae7b2d43f69bf1c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/197df0a528a707a30d8931883ae7b2d43f69bf1c.part --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/197df0a528a707a30d8931883ae7b2d43f69bf1c.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:22 user nova-compute[75293]: DEBUG nova.virt.images [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] 9e315b52-4bfa-4ef0-abfe-ca53d8b09b9f was qcow2, converting to raw {{(pid=75293) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 07:17:22 user nova-compute[75293]: DEBUG nova.privsep.utils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75293) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 07:17:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/197df0a528a707a30d8931883ae7b2d43f69bf1c.part /opt/stack/data/nova/instances/_base/197df0a528a707a30d8931883ae7b2d43f69bf1c.converted {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:22 user nova-compute[75293]: DEBUG nova.compute.manager [req-5ec5ffde-910d-4fc4-8fce-97f841fe559b req-7a758716-508b-41b0-911d-dba8e0c0b324 service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Received event network-vif-plugged-cc58bfc6-9bcd-41e7-aa0c-b14c293440e3 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5ec5ffde-910d-4fc4-8fce-97f841fe559b req-7a758716-508b-41b0-911d-dba8e0c0b324 service nova] Acquiring lock "821af6a7-0ab8-4947-afaf-e97b2b781375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5ec5ffde-910d-4fc4-8fce-97f841fe559b req-7a758716-508b-41b0-911d-dba8e0c0b324 service nova] Lock "821af6a7-0ab8-4947-afaf-e97b2b781375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5ec5ffde-910d-4fc4-8fce-97f841fe559b req-7a758716-508b-41b0-911d-dba8e0c0b324 service nova] Lock "821af6a7-0ab8-4947-afaf-e97b2b781375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:22 user nova-compute[75293]: DEBUG nova.compute.manager [req-5ec5ffde-910d-4fc4-8fce-97f841fe559b req-7a758716-508b-41b0-911d-dba8e0c0b324 service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] No waiting events found dispatching network-vif-plugged-cc58bfc6-9bcd-41e7-aa0c-b14c293440e3 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:17:22 user nova-compute[75293]: WARNING nova.compute.manager [req-5ec5ffde-910d-4fc4-8fce-97f841fe559b req-7a758716-508b-41b0-911d-dba8e0c0b324 service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Received unexpected event network-vif-plugged-cc58bfc6-9bcd-41e7-aa0c-b14c293440e3 for instance with vm_state building and task_state spawning.
Nov 30 07:17:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/197df0a528a707a30d8931883ae7b2d43f69bf1c.part /opt/stack/data/nova/instances/_base/197df0a528a707a30d8931883ae7b2d43f69bf1c.converted" returned: 0 in 0.647s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/197df0a528a707a30d8931883ae7b2d43f69bf1c.converted --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/197df0a528a707a30d8931883ae7b2d43f69bf1c.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "197df0a528a707a30d8931883ae7b2d43f69bf1c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.125s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "197df0a528a707a30d8931883ae7b2d43f69bf1c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "197df0a528a707a30d8931883ae7b2d43f69bf1c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/197df0a528a707a30d8931883ae7b2d43f69bf1c --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/197df0a528a707a30d8931883ae7b2d43f69bf1c --force-share --output=json" returned: 0 in 0.196s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/197df0a528a707a30d8931883ae7b2d43f69bf1c,backing_fmt=raw /opt/stack/data/nova/instances/9b9424a3-3053-4b8f-9eb9-5c81944a8fd5/disk.rescue {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/197df0a528a707a30d8931883ae7b2d43f69bf1c,backing_fmt=raw /opt/stack/data/nova/instances/9b9424a3-3053-4b8f-9eb9-5c81944a8fd5/disk.rescue" returned: 0 in 0.077s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "197df0a528a707a30d8931883ae7b2d43f69bf1c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.objects.instance [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'migration_context' on Instance uuid 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.objects.base [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Object Instance<9b9424a3-3053-4b8f-9eb9-5c81944a8fd5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Start _get_guest_xml network_info=[{"id": "094f0848-c129-4499-8781-6943982188b6", "address": "fa:16:3e:44:2f:52", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "vif_mac": "fa:16:3e:44:2f:52"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094f0848-c1", "ovs_interfaceid": "094f0848-c129-4499-8781-6943982188b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9e315b52-4bfa-4ef0-abfe-ca53d8b09b9f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlBbPIwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '9b9424a3-3053-4b8f-9eb9-5c81944a8fd5', 'attached_at': '', 'detached_at': '', 'volume_id': 'd2b68185-3fc6-4d60-b764-b8c4cb3ce54d', 'serial': 'd2b68185-3fc6-4d60-b764-b8c4cb3ce54d'}, 'delete_on_termination': False, 'attachment_id': '06f81404-d868-4073-87b0-e31c00210633', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.objects.instance [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'resources' on Instance uuid 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.objects.base [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Object Instance<9b9424a3-3053-4b8f-9eb9-5c81944a8fd5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.objects.instance [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'numa_topology' on Instance uuid 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.objects.base [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Object Instance<9b9424a3-3053-4b8f-9eb9-5c81944a8fd5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:17:23 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:17:23 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.objects.instance [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.objects.base [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Object Instance<9b9424a3-3053-4b8f-9eb9-5c81944a8fd5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlBbPIwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:17:23 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:17:23 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:17:23 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:17:23 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:17:23 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13a344d-ae5a-48eb-b13e-ec11216284be]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = tlBbPIwT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 30 07:17:23 user nova-compute[75293]: node.name = iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:17:23 user nova-compute[75293]: node.tpgt = -1
Nov 30 07:17:23 user nova-compute[75293]: node.startup = automatic
Nov 30 07:17:23 user nova-compute[75293]: node.leading_login = No
Nov 30 07:17:23 user nova-compute[75293]: iface.iscsi_ifacename = default
Nov 30 07:17:23 user nova-compute[75293]: iface.net_ifacename = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.ipaddress = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.prefix_len = 0
Nov 30 07:17:23 user nova-compute[75293]: iface.hwaddress = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.transport_name = tcp
Nov 30 07:17:23 user nova-compute[75293]: iface.initiatorname = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.state = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.vlan_id = 0
Nov 30 07:17:23 user nova-compute[75293]: iface.vlan_priority = 0
Nov 30 07:17:23 user nova-compute[75293]: iface.vlan_state = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.iface_num = 0
Nov 30 07:17:23 user nova-compute[75293]: iface.mtu = 0
Nov 30 07:17:23 user nova-compute[75293]: iface.port = 0
Nov 30 07:17:23 user nova-compute[75293]: iface.bootproto = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.subnet_mask = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.gateway = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.dhcp_alt_client_id_state = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.dhcp_alt_client_id = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.dhcp_dns = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.dhcp_learn_iqn = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.dhcp_req_vendor_id_state = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.dhcp_vendor_id_state = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.dhcp_vendor_id = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.dhcp_slp_da = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.fragmentation = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.gratuitous_arp = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.incoming_forwarding = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.tos_state = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.tos = 0
Nov 30 07:17:23 user nova-compute[75293]: iface.ttl = 0
Nov 30 07:17:23 user nova-compute[75293]: iface.delayed_ack = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.tcp_nagle = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.tcp_wsf_state = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.tcp_wsf = 0
Nov 30 07:17:23 user nova-compute[75293]: iface.tcp_timer_scale = 0
Nov 30 07:17:23 user nova-compute[75293]: iface.tcp_timestamp = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.redirect = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.def_task_mgmt_timeout = 0
Nov 30 07:17:23 user nova-compute[75293]: iface.header_digest = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.data_digest = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.immediate_data = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.initial_r2t = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.data_seq_inorder = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.data_pdu_inorder = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.erl = 0
Nov 30 07:17:23 user nova-compute[75293]: iface.max_receive_data_len = 0
Nov 30 07:17:23 user nova-compute[75293]: iface.first_burst_len = 0
Nov 30 07:17:23 user nova-compute[75293]: iface.max_outstanding_r2t = 0
Nov 30 07:17:23 user nova-compute[75293]: iface.max_burst_len = 0
Nov 30 07:17:23 user nova-compute[75293]: iface.chap_auth = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.bidi_chap = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.strict_login_compliance = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.discovery_auth = <empty>
Nov 30 07:17:23 user nova-compute[75293]: iface.discovery_logout = <empty>
Nov 30 07:17:23 user nova-compute[75293]: node.discovery_address = <empty>
Nov 30 07:17:23 user nova-compute[75293]: node.discovery_port = 0
Nov 30 07:17:23 user nova-compute[75293]: node.discovery_type = static
Nov 30 07:17:23 user nova-compute[75293]: node.session.initial_cmdsn = 0
Nov 30 07:17:23 user nova-compute[75293]: node.session.initial_login_retry_max = 8
Nov 30 07:17:23 user nova-compute[75293]: node.session.xmit_thread_priority = -20
Nov 30 07:17:23 user nova-compute[75293]: node.session.cmds_max = 128
Nov 30 07:17:23 user nova-compute[75293]: node.session.queue_depth = 32
Nov 30 07:17:23 user nova-compute[75293]: node.session.nr_sessions = 1
Nov 30 07:17:23 user nova-compute[75293]: node.session.auth.authmethod = CHAP
Nov 30 07:17:23 user nova-compute[75293]: node.session.auth.username = tlBbPIwT
Nov 30 07:17:23 user nova-compute[75293]: node.session.auth.password = ***
Nov 30 07:17:23 user nova-compute[75293]: node.session.auth.username_in = <empty>
Nov 30 07:17:23 user nova-compute[75293]: node.session.auth.password_in = <empty>
Nov 30 07:17:23 user nova-compute[75293]: node.session.auth.chap_algs = MD5
Nov 30 07:17:23 user nova-compute[75293]: node.session.timeo.replacement_timeout = 120
Nov 30 07:17:23 user nova-compute[75293]: node.session.err_timeo.abort_timeout = 15
Nov 30 07:17:23 user nova-compute[75293]: node.session.err_timeo.lu_reset_timeout = 30
Nov 30 07:17:23 user nova-compute[75293]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 30 07:17:23 user nova-compute[75293]: node.session.err_timeo.host_reset_timeout = 60
Nov 30 07:17:23 user nova-compute[75293]: node.session.iscsi.FastAbort = Yes
Nov 30 07:17:23 user nova-compute[75293]: node.session.iscsi.InitialR2T = No
Nov 30 07:17:23 user nova-compute[75293]: node.session.iscsi.ImmediateData = Yes
Nov 30 07:17:23 user nova-compute[75293]: node.session.iscsi.FirstBurstLength = 262144
Nov 30 07:17:23 user nova-compute[75293]: node.session.iscsi.MaxBurstLength = 16776192
Nov 30 07:17:23 user nova-compute[75293]: node.session.iscsi.DefaultTime2Retain = 0
Nov 30 07:17:23 user nova-compute[75293]: node.session.iscsi.DefaultTime2Wait = 2
Nov 30 07:17:23 user nova-compute[75293]: node.session.iscsi.MaxConnections = 1
Nov 30 07:17:23 user nova-compute[75293]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 30 07:17:23 user nova-compute[75293]: node.session.iscsi.ERL = 0
Nov 30 07:17:23 user nova-compute[75293]: node.session.scan = manual
Nov 30 07:17:23 user nova-compute[75293]: node.session.reopen_max = 0
Nov 30 07:17:23 user nova-compute[75293]: node.conn[0].address = 172.16.0.220
Nov 30 07:17:23 user nova-compute[75293]: node.conn[0].port = 3260
Nov 30 07:17:23 user nova-compute[75293]: node.conn[0].startup = manual
Nov 30 07:17:23 user nova-compute[75293]: node.conn[0].tcp.window_size = 524288
Nov 30 07:17:23 user nova-compute[75293]: node.conn[0].tcp.type_of_service = 0
Nov 30 07:17:23 user nova-compute[75293]: node.conn[0].timeo.logout_timeout = 15
Nov 30 07:17:23 user nova-compute[75293]: node.conn[0].timeo.login_timeout = 15
Nov 30 07:17:23 user nova-compute[75293]: node.conn[0].timeo.auth_timeout = 45
Nov 30 07:17:23 user nova-compute[75293]: node.conn[0].timeo.noop_out_interval = 5
Nov 30 07:17:23 user nova-compute[75293]: node.conn[0].timeo.noop_out_timeout = 5
Nov 30 07:17:23 user nova-compute[75293]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 30 07:17:23 user nova-compute[75293]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 30 07:17:23 user nova-compute[75293]: node.conn[0].iscsi.HeaderDigest = None
Nov 30 07:17:23 user nova-compute[75293]: node.conn[0].iscsi.DataDigest = None
Nov 30 07:17:23 user nova-compute[75293]: node.conn[0].iscsi.IFMarker = No
Nov 30 07:17:23 user nova-compute[75293]: node.conn[0].iscsi.OFMarker = No
Nov 30 07:17:23 user nova-compute[75293]: # END RECORD
Nov 30 07:17:23 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "f5162965-1cf1-4f92-86fc-88c1004748c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "f5162965-1cf1-4f92-86fc-88c1004748c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd652362-0881-4692-a559-326d6e3916bc]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1877e5fe-468c-420e-8daf-8e0f55b92e2e]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tlBbPIwT {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tlBbPIwT" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[95227c7d-1487-4c12-905a-c04abdc4908c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tlBbPIwT'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea3e512-69b8-401c-b9b1-c7633786ea00]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:17:24 user nova-compute[75293]: INFO nova.compute.claims [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Claim successful on node user
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[82edfbd1-6920-4766-b539-aa4b520f107b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:17:24 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:17:24 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:17:24 user nova-compute[75293]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:17:24 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:17:24 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:17:24 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:17:24 user nova-compute[75293]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:17:24 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.429s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] HCTL ('35', '0', '0', 0) found on session 26 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[172c515d-a422-4b65-a7b4-a30ad3e0e8a4]: (4, ('0 0 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Searching for a device in session 26 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlBbPIwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.454s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] <== connect_volume: return (456ms) {'type': 'block', 'scsi_wwn': '26136663537323537', 'path': '/dev/sdd'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136663537323537', 'path': '/dev/sdd'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:15:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-542946188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-542946188',id=26,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:15:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f09e4044dadb4f2aa0d29f35f23008d2',ramdisk_id='',reservation_id='r-wj45bcq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:15:50Z,user_data=None,user_id='83119c1bbe4142a086680a113403018c',uuid=9b9424a3-3053-4b8f-9eb9-5c81944a8fd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "094f0848-c129-4499-8781-6943982188b6", "address": "fa:16:3e:44:2f:52", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "vif_mac": "fa:16:3e:44:2f:52"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094f0848-c1", "ovs_interfaceid": "094f0848-c129-4499-8781-6943982188b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converting VIF {"id": "094f0848-c129-4499-8781-6943982188b6", "address": "fa:16:3e:44:2f:52", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "vif_mac": "fa:16:3e:44:2f:52"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094f0848-c1", "ovs_interfaceid": "094f0848-c129-4499-8781-6943982188b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:2f:52,bridge_name='br-int',has_traffic_filtering=True,id=094f0848-c129-4499-8781-6943982188b6,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094f0848-c1') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.objects.instance [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.objects.base [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Object Instance<9b9424a3-3053-4b8f-9eb9-5c81944a8fd5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:17:24 user nova-compute[75293]:   <uuid>9b9424a3-3053-4b8f-9eb9-5c81944a8fd5</uuid>
Nov 30 07:17:24 user nova-compute[75293]:   <name>instance-0000001a</name>
Nov 30 07:17:24 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:17:24 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:17:24 user nova-compute[75293]:   <metadata>
Nov 30 07:17:24 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:17:24 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:17:24 user nova-compute[75293]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-542946188</nova:name>
Nov 30 07:17:24 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:17:23</nova:creationTime>
Nov 30 07:17:24 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:17:24 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:17:24 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:17:24 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:17:24 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:17:24 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:17:24 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:17:24 user nova-compute[75293]:       <nova:owner>
Nov 30 07:17:24 user nova-compute[75293]:         <nova:user uuid="83119c1bbe4142a086680a113403018c">tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member</nova:user>
Nov 30 07:17:24 user nova-compute[75293]:         <nova:project uuid="f09e4044dadb4f2aa0d29f35f23008d2">tempest-ServerBootFromVolumeStableRescueTest-2053873633</nova:project>
Nov 30 07:17:24 user nova-compute[75293]:       </nova:owner>
Nov 30 07:17:24 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:17:24 user nova-compute[75293]:       <nova:ports>
Nov 30 07:17:24 user nova-compute[75293]:         <nova:port uuid="094f0848-c129-4499-8781-6943982188b6">
Nov 30 07:17:24 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 07:17:24 user nova-compute[75293]:         </nova:port>
Nov 30 07:17:24 user nova-compute[75293]:       </nova:ports>
Nov 30 07:17:24 user nova-compute[75293]:     </nova:instance>
Nov 30 07:17:24 user nova-compute[75293]:   </metadata>
Nov 30 07:17:24 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:17:24 user nova-compute[75293]:     <system>
Nov 30 07:17:24 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:17:24 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:17:24 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:17:24 user nova-compute[75293]:       <entry name="serial">9b9424a3-3053-4b8f-9eb9-5c81944a8fd5</entry>
Nov 30 07:17:24 user nova-compute[75293]:       <entry name="uuid">9b9424a3-3053-4b8f-9eb9-5c81944a8fd5</entry>
Nov 30 07:17:24 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:17:24 user nova-compute[75293]:     </system>
Nov 30 07:17:24 user nova-compute[75293]:   </sysinfo>
Nov 30 07:17:24 user nova-compute[75293]:   <os>
Nov 30 07:17:24 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:17:24 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:17:24 user nova-compute[75293]:   </os>
Nov 30 07:17:24 user nova-compute[75293]:   <features>
Nov 30 07:17:24 user nova-compute[75293]:     <acpi/>
Nov 30 07:17:24 user nova-compute[75293]:     <apic/>
Nov 30 07:17:24 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:17:24 user nova-compute[75293]:   </features>
Nov 30 07:17:24 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:17:24 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:17:24 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:17:24 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:17:24 user nova-compute[75293]:   </clock>
Nov 30 07:17:24 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:17:24 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:17:24 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:17:24 user nova-compute[75293]:   </cpu>
Nov 30 07:17:24 user nova-compute[75293]:   <devices>
Nov 30 07:17:24 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:17:24 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:17:24 user nova-compute[75293]:       <source dev="/dev/sdd"/>
Nov 30 07:17:24 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:17:24 user nova-compute[75293]:       <serial>d2b68185-3fc6-4d60-b764-b8c4cb3ce54d</serial>
Nov 30 07:17:24 user nova-compute[75293]:     </disk>
Nov 30 07:17:24 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:17:24 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:17:24 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/9b9424a3-3053-4b8f-9eb9-5c81944a8fd5/disk.rescue"/>
Nov 30 07:17:24 user nova-compute[75293]:       <target dev="vdb" bus="virtio"/>
Nov 30 07:17:24 user nova-compute[75293]:       <boot order="1"/>
Nov 30 07:17:24 user nova-compute[75293]:     </disk>
Nov 30 07:17:24 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:17:24 user nova-compute[75293]:       <mac address="fa:16:3e:44:2f:52"/>
Nov 30 07:17:24 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:17:24 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:17:24 user nova-compute[75293]:       <target dev="tap094f0848-c1"/>
Nov 30 07:17:24 user nova-compute[75293]:     </interface>
Nov 30 07:17:24 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:17:24 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/9b9424a3-3053-4b8f-9eb9-5c81944a8fd5/console.log" append="off"/>
Nov 30 07:17:24 user nova-compute[75293]:     </serial>
Nov 30 07:17:24 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:17:24 user nova-compute[75293]:     <video>
Nov 30 07:17:24 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:17:24 user nova-compute[75293]:     </video>
Nov 30 07:17:24 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:17:24 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:17:24 user nova-compute[75293]:     </rng>
Nov 30 07:17:24 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:17:24 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:17:24 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:17:24 user nova-compute[75293]:     </memballoon>
Nov 30 07:17:24 user nova-compute[75293]:   </devices>
Nov 30 07:17:24 user nova-compute[75293]: </domain>
Nov 30 07:17:24 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:17:24 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Instance destroyed successfully.
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] No VIF found with MAC fa:16:3e:44:2f:52, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:17:24 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.policy [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abe34a1b2c38472d831ae5d7afa85c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ff34b2e2c047319c1fe166c5029790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-d75ba63c-811b-428b-931d-ff6dec9a67ba req-ea563d4a-9a27-4bd8-8b4d-0d31d7c2883e service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Received event network-vif-plugged-cc58bfc6-9bcd-41e7-aa0c-b14c293440e3 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d75ba63c-811b-428b-931d-ff6dec9a67ba req-ea563d4a-9a27-4bd8-8b4d-0d31d7c2883e service nova] Acquiring lock "821af6a7-0ab8-4947-afaf-e97b2b781375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d75ba63c-811b-428b-931d-ff6dec9a67ba req-ea563d4a-9a27-4bd8-8b4d-0d31d7c2883e service nova] Lock "821af6a7-0ab8-4947-afaf-e97b2b781375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d75ba63c-811b-428b-931d-ff6dec9a67ba req-ea563d4a-9a27-4bd8-8b4d-0d31d7c2883e service nova] Lock "821af6a7-0ab8-4947-afaf-e97b2b781375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-d75ba63c-811b-428b-931d-ff6dec9a67ba req-ea563d4a-9a27-4bd8-8b4d-0d31d7c2883e service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] No waiting events found dispatching network-vif-plugged-cc58bfc6-9bcd-41e7-aa0c-b14c293440e3 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:17:24 user nova-compute[75293]: WARNING nova.compute.manager [req-d75ba63c-811b-428b-931d-ff6dec9a67ba req-ea563d4a-9a27-4bd8-8b4d-0d31d7c2883e service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Received unexpected event network-vif-plugged-cc58bfc6-9bcd-41e7-aa0c-b14c293440e3 for instance with vm_state building and task_state spawning.
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-d75ba63c-811b-428b-931d-ff6dec9a67ba req-ea563d4a-9a27-4bd8-8b4d-0d31d7c2883e service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received event network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d75ba63c-811b-428b-931d-ff6dec9a67ba req-ea563d4a-9a27-4bd8-8b4d-0d31d7c2883e service nova] Acquiring lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d75ba63c-811b-428b-931d-ff6dec9a67ba req-ea563d4a-9a27-4bd8-8b4d-0d31d7c2883e service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d75ba63c-811b-428b-931d-ff6dec9a67ba req-ea563d4a-9a27-4bd8-8b4d-0d31d7c2883e service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-d75ba63c-811b-428b-931d-ff6dec9a67ba req-ea563d4a-9a27-4bd8-8b4d-0d31d7c2883e service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] No waiting events found dispatching network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:17:24 user nova-compute[75293]: WARNING nova.compute.manager [req-d75ba63c-811b-428b-931d-ff6dec9a67ba req-ea563d4a-9a27-4bd8-8b4d-0d31d7c2883e service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received unexpected event network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a for instance with vm_state active and task_state rebuild_spawning.
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-d75ba63c-811b-428b-931d-ff6dec9a67ba req-ea563d4a-9a27-4bd8-8b4d-0d31d7c2883e service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received event network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d75ba63c-811b-428b-931d-ff6dec9a67ba req-ea563d4a-9a27-4bd8-8b4d-0d31d7c2883e service nova] Acquiring lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d75ba63c-811b-428b-931d-ff6dec9a67ba req-ea563d4a-9a27-4bd8-8b4d-0d31d7c2883e service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d75ba63c-811b-428b-931d-ff6dec9a67ba req-ea563d4a-9a27-4bd8-8b4d-0d31d7c2883e service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-d75ba63c-811b-428b-931d-ff6dec9a67ba req-ea563d4a-9a27-4bd8-8b4d-0d31d7c2883e service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] No waiting events found dispatching network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:17:24 user nova-compute[75293]: WARNING nova.compute.manager [req-d75ba63c-811b-428b-931d-ff6dec9a67ba req-ea563d4a-9a27-4bd8-8b4d-0d31d7c2883e service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received unexpected event network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a for instance with vm_state active and task_state rebuild_spawning.
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:17:24 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Creating image(s)
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "/opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "/opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.179s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.188s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/disk 1073741824" returned: 0 in 0.063s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.compute.manager [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.compute.manager [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:17:25 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Instance spawned successfully.
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:17:25 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Instance spawned successfully.
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Successfully created port: 7ed89ba2-1320-471a-ba57-e161b88f61cf {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:25 user nova-compute[75293]: INFO nova.compute.manager [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Took 8.55 seconds to spawn the instance on the hypervisor.
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.compute.manager [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.241s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.compute.manager [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:17:25 user nova-compute[75293]: INFO nova.compute.manager [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Took 9.29 seconds to build instance.
Nov 30 07:17:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-96676433-05de-4a56-a2a5-3dbcec91746b tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "821af6a7-0ab8-4947-afaf-e97b2b781375" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.445s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.objects.instance [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75293) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Cannot resize image /opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Ensure instance console log exists: /opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9f98e34a-91d4-4b4b-aaa6-306f289efa75 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.091s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Successfully updated port: 7ed89ba2-1320-471a-ba57-e161b88f61cf {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "refresh_cache-f5162965-1cf1-4f92-86fc-88c1004748c8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquired lock "refresh_cache-f5162965-1cf1-4f92-86fc-88c1004748c8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received event network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] Acquiring lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] No waiting events found dispatching network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:17:26 user nova-compute[75293]: WARNING nova.compute.manager [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received unexpected event network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 for instance with vm_state active and task_state rescuing.
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received event network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] Acquiring lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] No waiting events found dispatching network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:17:26 user nova-compute[75293]: WARNING nova.compute.manager [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received unexpected event network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 for instance with vm_state active and task_state rescuing.
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Received event network-changed-7ed89ba2-1320-471a-ba57-e161b88f61cf {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Refreshing instance network info cache due to event network-changed-7ed89ba2-1320-471a-ba57-e161b88f61cf. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] Acquiring lock "refresh_cache-f5162965-1cf1-4f92-86fc-88c1004748c8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Updating instance_info_cache with network_info: [{"id": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "address": "fa:16:3e:d8:ea:c8", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed89ba2-13", "ovs_interfaceid": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Releasing lock "refresh_cache-f5162965-1cf1-4f92-86fc-88c1004748c8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Instance network_info: |[{"id": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "address": "fa:16:3e:d8:ea:c8", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed89ba2-13", "ovs_interfaceid": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] Acquired lock "refresh_cache-f5162965-1cf1-4f92-86fc-88c1004748c8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.network.neutron [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Refreshing network info cache for port 7ed89ba2-1320-471a-ba57-e161b88f61cf {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Start _get_guest_xml network_info=[{"id": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "address": "fa:16:3e:d8:ea:c8", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed89ba2-13", "ovs_interfaceid": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:17:26 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:17:26 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:17:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1421709832',display_name='tempest-AttachVolumeNegativeTest-server-1421709832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1421709832',id=29,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNilbMRWaGvJdBWmq6u/iywUvDErJySkQ/E7z9YgbqijYzBdnbe6nryyr90bRZexzNUwfkUriij/AZr0uvUKLWsE+NklA9AcXqc4mvLQBrQTJbAMLMQg1ZVIM/kFXzBprw==',key_name='tempest-keypair-137756123',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68ff34b2e2c047319c1fe166c5029790',ramdisk_id='',reservation_id='r-5m667wvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1915468397',owner_user_name='tempest-AttachVolumeNegativeTest-1915468397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe34a1b2c38472d831ae5d7afa85c77',uuid=f5162965-1cf1-4f92-86fc-88c1004748c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "address": "fa:16:3e:d8:ea:c8", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed89ba2-13", "ovs_interfaceid": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converting VIF {"id": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "address": "fa:16:3e:d8:ea:c8", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed89ba2-13", "ovs_interfaceid": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:ea:c8,bridge_name='br-int',has_traffic_filtering=True,id=7ed89ba2-1320-471a-ba57-e161b88f61cf,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed89ba2-13') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG nova.objects.instance [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lazy-loading 'pci_devices' on Instance uuid f5162965-1cf1-4f92-86fc-88c1004748c8 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:17:27 user nova-compute[75293]:   <uuid>f5162965-1cf1-4f92-86fc-88c1004748c8</uuid>
Nov 30 07:17:27 user nova-compute[75293]:   <name>instance-0000001d</name>
Nov 30 07:17:27 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:17:27 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:17:27 user nova-compute[75293]:   <metadata>
Nov 30 07:17:27 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:17:27 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:17:27 user nova-compute[75293]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1421709832</nova:name>
Nov 30 07:17:27 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:17:26</nova:creationTime>
Nov 30 07:17:27 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:17:27 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:17:27 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:17:27 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:17:27 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:17:27 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:17:27 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:17:27 user nova-compute[75293]:       <nova:owner>
Nov 30 07:17:27 user nova-compute[75293]:         <nova:user uuid="abe34a1b2c38472d831ae5d7afa85c77">tempest-AttachVolumeNegativeTest-1915468397-project-member</nova:user>
Nov 30 07:17:27 user nova-compute[75293]:         <nova:project uuid="68ff34b2e2c047319c1fe166c5029790">tempest-AttachVolumeNegativeTest-1915468397</nova:project>
Nov 30 07:17:27 user nova-compute[75293]:       </nova:owner>
Nov 30 07:17:27 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:17:27 user nova-compute[75293]:       <nova:ports>
Nov 30 07:17:27 user nova-compute[75293]:         <nova:port uuid="7ed89ba2-1320-471a-ba57-e161b88f61cf">
Nov 30 07:17:27 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 07:17:27 user nova-compute[75293]:         </nova:port>
Nov 30 07:17:27 user nova-compute[75293]:       </nova:ports>
Nov 30 07:17:27 user nova-compute[75293]:     </nova:instance>
Nov 30 07:17:27 user nova-compute[75293]:   </metadata>
Nov 30 07:17:27 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:17:27 user nova-compute[75293]:     <system>
Nov 30 07:17:27 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:17:27 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:17:27 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:17:27 user nova-compute[75293]:       <entry name="serial">f5162965-1cf1-4f92-86fc-88c1004748c8</entry>
Nov 30 07:17:27 user nova-compute[75293]:       <entry name="uuid">f5162965-1cf1-4f92-86fc-88c1004748c8</entry>
Nov 30 07:17:27 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:17:27 user nova-compute[75293]:     </system>
Nov 30 07:17:27 user nova-compute[75293]:   </sysinfo>
Nov 30 07:17:27 user nova-compute[75293]:   <os>
Nov 30 07:17:27 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:17:27 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:17:27 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:17:27 user nova-compute[75293]:   </os>
Nov 30 07:17:27 user nova-compute[75293]:   <features>
Nov 30 07:17:27 user nova-compute[75293]:     <acpi/>
Nov 30 07:17:27 user nova-compute[75293]:     <apic/>
Nov 30 07:17:27 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:17:27 user nova-compute[75293]:   </features>
Nov 30 07:17:27 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:17:27 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:17:27 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:17:27 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:17:27 user nova-compute[75293]:   </clock>
Nov 30 07:17:27 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:17:27 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:17:27 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:17:27 user nova-compute[75293]:   </cpu>
Nov 30 07:17:27 user nova-compute[75293]:   <devices>
Nov 30 07:17:27 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:17:27 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:17:27 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/disk"/>
Nov 30 07:17:27 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:17:27 user nova-compute[75293]:     </disk>
Nov 30 07:17:27 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:17:27 user nova-compute[75293]:       <mac address="fa:16:3e:d8:ea:c8"/>
Nov 30 07:17:27 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:17:27 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:17:27 user nova-compute[75293]:       <target dev="tap7ed89ba2-13"/>
Nov 30 07:17:27 user nova-compute[75293]:     </interface>
Nov 30 07:17:27 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:17:27 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/console.log" append="off"/>
Nov 30 07:17:27 user nova-compute[75293]:     </serial>
Nov 30 07:17:27 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:17:27 user nova-compute[75293]:     <video>
Nov 30 07:17:27 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:17:27 user nova-compute[75293]:     </video>
Nov 30 07:17:27 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:17:27 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:17:27 user nova-compute[75293]:     </rng>
Nov 30 07:17:27 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:17:27 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:17:27 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:17:27 user nova-compute[75293]:     </memballoon>
Nov 30 07:17:27 user nova-compute[75293]:   </devices>
Nov 30 07:17:27 user nova-compute[75293]: </domain>
Nov 30 07:17:27 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1421709832',display_name='tempest-AttachVolumeNegativeTest-server-1421709832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1421709832',id=29,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNilbMRWaGvJdBWmq6u/iywUvDErJySkQ/E7z9YgbqijYzBdnbe6nryyr90bRZexzNUwfkUriij/AZr0uvUKLWsE+NklA9AcXqc4mvLQBrQTJbAMLMQg1ZVIM/kFXzBprw==',key_name='tempest-keypair-137756123',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68ff34b2e2c047319c1fe166c5029790',ramdisk_id='',reservation_id='r-5m667wvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1915468397',owner_user_name='tempest-AttachVolumeNegativeTest-1915468397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe34a1b2c38472d831ae5d7afa85c77',uuid=f5162965-1cf1-4f92-86fc-88c1004748c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "address": "fa:16:3e:d8:ea:c8", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed89ba2-13", "ovs_interfaceid": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converting VIF {"id": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "address": "fa:16:3e:d8:ea:c8", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed89ba2-13", "ovs_interfaceid": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:ea:c8,bridge_name='br-int',has_traffic_filtering=True,id=7ed89ba2-1320-471a-ba57-e161b88f61cf,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed89ba2-13') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG os_vif [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:ea:c8,bridge_name='br-int',has_traffic_filtering=True,id=7ed89ba2-1320-471a-ba57-e161b88f61cf,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed89ba2-13') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4aa620a5-c740-56c2-b5e5-c693b3eeab01', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ed89ba2-13, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ed89ba2-13, col_values=(('qos', UUID('b412db85-6999-4831-9190-7d1de5afe213')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ed89ba2-13, col_values=(('external_ids', {'iface-id': '7ed89ba2-1320-471a-ba57-e161b88f61cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:ea:c8', 'vm-uuid': 'f5162965-1cf1-4f92-86fc-88c1004748c8'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:27 user nova-compute[75293]: INFO os_vif [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:ea:c8,bridge_name='br-int',has_traffic_filtering=True,id=7ed89ba2-1320-471a-ba57-e161b88f61cf,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed89ba2-13')
Nov 30 07:17:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] No VIF found with MAC fa:16:3e:d8:ea:c8, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG nova.network.neutron [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Updated VIF entry in instance network info cache for port 7ed89ba2-1320-471a-ba57-e161b88f61cf. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG nova.network.neutron [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Updating instance_info_cache with network_info: [{"id": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "address": "fa:16:3e:d8:ea:c8", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed89ba2-13", "ovs_interfaceid": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3ae3b66a-edae-48d6-a115-c8200fdbfa07 req-700b8929-b4da-4908-a666-3027fac8d9a4 service nova] Releasing lock "refresh_cache-f5162965-1cf1-4f92-86fc-88c1004748c8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:17:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:17:28 user nova-compute[75293]: INFO nova.compute.manager [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] instance snapshotting
Nov 30 07:17:28 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Beginning live snapshot process
Nov 30 07:17:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json -f qcow2 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:28 user nova-compute[75293]: DEBUG nova.compute.manager [None req-a45fb22a-77eb-455f-93ef-cae114f686dd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:17:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json -f qcow2" returned: 0 in 0.266s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json -f qcow2 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json -f qcow2" returned: 0 in 0.230s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:28 user nova-compute[75293]: DEBUG nova.compute.manager [req-d0b23f47-2eda-4d8c-8ec5-ab3bfdb2b198 req-965a73b1-dde3-46c7-aaa8-a73a4f34f6a9 service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Received event network-vif-plugged-7ed89ba2-1320-471a-ba57-e161b88f61cf {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d0b23f47-2eda-4d8c-8ec5-ab3bfdb2b198 req-965a73b1-dde3-46c7-aaa8-a73a4f34f6a9 service nova] Acquiring lock "f5162965-1cf1-4f92-86fc-88c1004748c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d0b23f47-2eda-4d8c-8ec5-ab3bfdb2b198 req-965a73b1-dde3-46c7-aaa8-a73a4f34f6a9 service nova] Lock "f5162965-1cf1-4f92-86fc-88c1004748c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d0b23f47-2eda-4d8c-8ec5-ab3bfdb2b198 req-965a73b1-dde3-46c7-aaa8-a73a4f34f6a9 service nova] Lock "f5162965-1cf1-4f92-86fc-88c1004748c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:28 user nova-compute[75293]: DEBUG nova.compute.manager [req-d0b23f47-2eda-4d8c-8ec5-ab3bfdb2b198 req-965a73b1-dde3-46c7-aaa8-a73a4f34f6a9 service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] No waiting events found dispatching network-vif-plugged-7ed89ba2-1320-471a-ba57-e161b88f61cf {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:17:28 user nova-compute[75293]: WARNING nova.compute.manager [req-d0b23f47-2eda-4d8c-8ec5-ab3bfdb2b198 req-965a73b1-dde3-46c7-aaa8-a73a4f34f6a9 service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Received unexpected event network-vif-plugged-7ed89ba2-1320-471a-ba57-e161b88f61cf for instance with vm_state building and task_state spawning.
Nov 30 07:17:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.234s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnm0p10e9/36d2c1ae7f804078ad662c7bdd124926.delta 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnm0p10e9/36d2c1ae7f804078ad662c7bdd124926.delta 1073741824" returned: 0 in 0.054s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:29 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 07:17:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:17:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:17:30 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 07:17:30 user nova-compute[75293]: DEBUG nova.privsep.utils [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75293) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 07:17:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnm0p10e9/36d2c1ae7f804078ad662c7bdd124926.delta /opt/stack/data/nova/instances/snapshots/tmpnm0p10e9/36d2c1ae7f804078ad662c7bdd124926 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-4f52bd8f-6d38-44c1-8335-4c7a9fe1fcb8 req-4baa56c7-f570-487b-ba0f-7748cf1acbd7 service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Received event network-vif-plugged-7ed89ba2-1320-471a-ba57-e161b88f61cf {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4f52bd8f-6d38-44c1-8335-4c7a9fe1fcb8 req-4baa56c7-f570-487b-ba0f-7748cf1acbd7 service nova] Acquiring lock "f5162965-1cf1-4f92-86fc-88c1004748c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4f52bd8f-6d38-44c1-8335-4c7a9fe1fcb8 req-4baa56c7-f570-487b-ba0f-7748cf1acbd7 service nova] Lock "f5162965-1cf1-4f92-86fc-88c1004748c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4f52bd8f-6d38-44c1-8335-4c7a9fe1fcb8 req-4baa56c7-f570-487b-ba0f-7748cf1acbd7 service nova] Lock "f5162965-1cf1-4f92-86fc-88c1004748c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-4f52bd8f-6d38-44c1-8335-4c7a9fe1fcb8 req-4baa56c7-f570-487b-ba0f-7748cf1acbd7 service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] No waiting events found dispatching network-vif-plugged-7ed89ba2-1320-471a-ba57-e161b88f61cf {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:17:30 user nova-compute[75293]: WARNING nova.compute.manager [req-4f52bd8f-6d38-44c1-8335-4c7a9fe1fcb8 req-4baa56c7-f570-487b-ba0f-7748cf1acbd7 service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Received unexpected event network-vif-plugged-7ed89ba2-1320-471a-ba57-e161b88f61cf for instance with vm_state building and task_state spawning.
Nov 30 07:17:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnm0p10e9/36d2c1ae7f804078ad662c7bdd124926.delta /opt/stack/data/nova/instances/snapshots/tmpnm0p10e9/36d2c1ae7f804078ad662c7bdd124926" returned: 0 in 0.455s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:30 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Snapshot extracted, beginning image upload
Nov 30 07:17:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:31 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:17:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:17:31 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Instance spawned successfully.
Nov 30 07:17:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:17:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:31 user nova-compute[75293]: INFO nova.compute.manager [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Took 6.91 seconds to spawn the instance on the hypervisor.
Nov 30 07:17:31 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:17:31 user nova-compute[75293]: INFO nova.compute.manager [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Took 7.73 seconds to build instance.
Nov 30 07:17:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d85703a3-c306-40bf-a996-3a0b7d3b47e9 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "f5162965-1cf1-4f92-86fc-88c1004748c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.851s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:33 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Snapshot image upload complete
Nov 30 07:17:33 user nova-compute[75293]: INFO nova.compute.manager [None req-da99163f-2799-48df-830f-c2ab290bd517 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Took 5.79 seconds to snapshot the instance on the hypervisor.
Nov 30 07:17:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:36 user nova-compute[75293]: DEBUG nova.compute.manager [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:17:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:36 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:17:36 user nova-compute[75293]: INFO nova.compute.claims [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Claim successful on node user
Nov 30 07:17:36 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:17:36 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:17:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:36 user nova-compute[75293]: DEBUG nova.compute.manager [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:17:36 user nova-compute[75293]: DEBUG nova.compute.manager [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:17:36 user nova-compute[75293]: DEBUG nova.network.neutron [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:17:36 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:17:36 user nova-compute[75293]: DEBUG nova.compute.manager [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:17:36 user nova-compute[75293]: DEBUG nova.policy [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bec86b562bb54d7c9e10d8ce99723460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3973d2dcb7674ea5b11eb2007f26df78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:17:37 user nova-compute[75293]: DEBUG nova.compute.manager [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:17:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:17:37 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Creating image(s)
Nov 30 07:17:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "/opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "/opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "/opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "700fffce1bbef0190fdcd6e41696c97b5a2c0248" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "700fffce1bbef0190fdcd6e41696c97b5a2c0248" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/700fffce1bbef0190fdcd6e41696c97b5a2c0248.part --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:38 user nova-compute[75293]: DEBUG nova.network.neutron [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Successfully created port: dae8d2c1-7bef-420e-b14b-911f6552261b {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:17:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/700fffce1bbef0190fdcd6e41696c97b5a2c0248.part --force-share --output=json" returned: 0 in 0.231s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:38 user nova-compute[75293]: DEBUG nova.virt.images [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] 50d27170-e54d-40e0-9d79-31e4ded1fe5d was qcow2, converting to raw {{(pid=75293) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 07:17:38 user nova-compute[75293]: DEBUG nova.privsep.utils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75293) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 07:17:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/700fffce1bbef0190fdcd6e41696c97b5a2c0248.part /opt/stack/data/nova/instances/_base/700fffce1bbef0190fdcd6e41696c97b5a2c0248.converted {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/700fffce1bbef0190fdcd6e41696c97b5a2c0248.part /opt/stack/data/nova/instances/_base/700fffce1bbef0190fdcd6e41696c97b5a2c0248.converted" returned: 0 in 0.435s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/700fffce1bbef0190fdcd6e41696c97b5a2c0248.converted --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/700fffce1bbef0190fdcd6e41696c97b5a2c0248.converted --force-share --output=json" returned: 0 in 0.255s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "700fffce1bbef0190fdcd6e41696c97b5a2c0248" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.873s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/700fffce1bbef0190fdcd6e41696c97b5a2c0248 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:38 user nova-compute[75293]: DEBUG nova.network.neutron [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Successfully updated port: dae8d2c1-7bef-420e-b14b-911f6552261b {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "refresh_cache-04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquired lock "refresh_cache-04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.network.neutron [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.compute.manager [req-79927792-b990-4c82-9cf6-67488ed5a409 req-f609db0b-c977-4d26-9c9d-fcddcc633cf4 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Received event network-changed-dae8d2c1-7bef-420e-b14b-911f6552261b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.compute.manager [req-79927792-b990-4c82-9cf6-67488ed5a409 req-f609db0b-c977-4d26-9c9d-fcddcc633cf4 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Refreshing instance network info cache due to event network-changed-dae8d2c1-7bef-420e-b14b-911f6552261b. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-79927792-b990-4c82-9cf6-67488ed5a409 req-f609db0b-c977-4d26-9c9d-fcddcc633cf4 service nova] Acquiring lock "refresh_cache-04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.network.neutron [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/700fffce1bbef0190fdcd6e41696c97b5a2c0248 --force-share --output=json" returned: 0 in 0.227s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "700fffce1bbef0190fdcd6e41696c97b5a2c0248" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "700fffce1bbef0190fdcd6e41696c97b5a2c0248" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/700fffce1bbef0190fdcd6e41696c97b5a2c0248 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/700fffce1bbef0190fdcd6e41696c97b5a2c0248 --force-share --output=json" returned: 0 in 0.193s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/700fffce1bbef0190fdcd6e41696c97b5a2c0248,backing_fmt=raw /opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/700fffce1bbef0190fdcd6e41696c97b5a2c0248,backing_fmt=raw /opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/disk 1073741824" returned: 0 in 0.055s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "700fffce1bbef0190fdcd6e41696c97b5a2c0248" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/700fffce1bbef0190fdcd6e41696c97b5a2c0248 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.network.neutron [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Updating instance_info_cache with network_info: [{"id": "dae8d2c1-7bef-420e-b14b-911f6552261b", "address": "fa:16:3e:d0:1c:74", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae8d2c1-7b", "ovs_interfaceid": "dae8d2c1-7bef-420e-b14b-911f6552261b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Releasing lock "refresh_cache-04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.compute.manager [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Instance network_info: |[{"id": "dae8d2c1-7bef-420e-b14b-911f6552261b", "address": "fa:16:3e:d0:1c:74", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae8d2c1-7b", "ovs_interfaceid": "dae8d2c1-7bef-420e-b14b-911f6552261b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-79927792-b990-4c82-9cf6-67488ed5a409 req-f609db0b-c977-4d26-9c9d-fcddcc633cf4 service nova] Acquired lock "refresh_cache-04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.network.neutron [req-79927792-b990-4c82-9cf6-67488ed5a409 req-f609db0b-c977-4d26-9c9d-fcddcc633cf4 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Refreshing network info cache for port dae8d2c1-7bef-420e-b14b-911f6552261b {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/700fffce1bbef0190fdcd6e41696c97b5a2c0248 --force-share --output=json" returned: 0 in 0.194s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Ensure instance console log exists: /opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Start _get_guest_xml network_info=[{"id": "dae8d2c1-7bef-420e-b14b-911f6552261b", "address": "fa:16:3e:d0:1c:74", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae8d2c1-7b", "ovs_interfaceid": "dae8d2c1-7bef-420e-b14b-911f6552261b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5dbbd7f0957c3331f48b84391e1e3008',container_format='bare',created_at=2023-11-30T07:17:28Z,direct_url=<?>,disk_format='qcow2',id=50d27170-e54d-40e0-9d79-31e4ded1fe5d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1103244457',owner='3973d2dcb7674ea5b11eb2007f26df78',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-30T07:17:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '50d27170-e54d-40e0-9d79-31e4ded1fe5d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:17:39 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:17:39 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5dbbd7f0957c3331f48b84391e1e3008',container_format='bare',created_at=2023-11-30T07:17:28Z,direct_url=<?>,disk_format='qcow2',id=50d27170-e54d-40e0-9d79-31e4ded1fe5d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1103244457',owner='3973d2dcb7674ea5b11eb2007f26df78',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-30T07:17:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-194695443',display_name='tempest-TestStampPattern-server-194695443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-194695443',id=30,image_ref='50d27170-e54d-40e0-9d79-31e4ded1fe5d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0qMxl7UVzzNRBhKaK7jCT6r/53GRkB3Di+2AcuMeqPobnGiie2ivpr0tiN4y2/+N5eqEzUQwswDBS+N1ym58HFieIzNbbIOVxlbtYOwXvyj9jGINm6Alzpe31PR/dT3g==',key_name='tempest-TestStampPattern-1639076054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3973d2dcb7674ea5b11eb2007f26df78',ramdisk_id='',reservation_id='r-bthdhn49',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d34f99fc-343e-4e8a-83e6-372b0326bded',image_min_disk='1',image_min_ram='0',image_owner_id='3973d2dcb7674ea5b11eb2007f26df78',image_owner_project_name='tempest-TestStampPattern-1058543327',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1058543327-project-member',image_user_id='bec86b562bb54d7c9e10d8ce99723460',network_allocated='True',owner_project_name='tempest-TestStampPattern-1058543327',owner_user_name='tempest-TestStampPattern-1058543327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:17:37Z,user_data=None,user_id='bec86b562bb54d7c9e10d8ce99723460',uuid=04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dae8d2c1-7bef-420e-b14b-911f6552261b", "address": "fa:16:3e:d0:1c:74", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae8d2c1-7b", "ovs_interfaceid": "dae8d2c1-7bef-420e-b14b-911f6552261b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Converting VIF {"id": "dae8d2c1-7bef-420e-b14b-911f6552261b", "address": "fa:16:3e:d0:1c:74", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae8d2c1-7b", "ovs_interfaceid": "dae8d2c1-7bef-420e-b14b-911f6552261b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=dae8d2c1-7bef-420e-b14b-911f6552261b,network=Network(bab4085c-ab04-4e03-912e-6c6c8fde90b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae8d2c1-7b') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.objects.instance [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lazy-loading 'pci_devices' on Instance uuid 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:17:39 user nova-compute[75293]:   <uuid>04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7</uuid>
Nov 30 07:17:39 user nova-compute[75293]:   <name>instance-0000001e</name>
Nov 30 07:17:39 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:17:39 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:17:39 user nova-compute[75293]:   <metadata>
Nov 30 07:17:39 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:17:39 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:17:39 user nova-compute[75293]:       <nova:name>tempest-TestStampPattern-server-194695443</nova:name>
Nov 30 07:17:39 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:17:39</nova:creationTime>
Nov 30 07:17:39 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:17:39 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:17:39 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:17:39 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:17:39 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:17:39 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:17:39 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:17:39 user nova-compute[75293]:       <nova:owner>
Nov 30 07:17:39 user nova-compute[75293]:         <nova:user uuid="bec86b562bb54d7c9e10d8ce99723460">tempest-TestStampPattern-1058543327-project-member</nova:user>
Nov 30 07:17:39 user nova-compute[75293]:         <nova:project uuid="3973d2dcb7674ea5b11eb2007f26df78">tempest-TestStampPattern-1058543327</nova:project>
Nov 30 07:17:39 user nova-compute[75293]:       </nova:owner>
Nov 30 07:17:39 user nova-compute[75293]:       <nova:root type="image" uuid="50d27170-e54d-40e0-9d79-31e4ded1fe5d"/>
Nov 30 07:17:39 user nova-compute[75293]:       <nova:ports>
Nov 30 07:17:39 user nova-compute[75293]:         <nova:port uuid="dae8d2c1-7bef-420e-b14b-911f6552261b">
Nov 30 07:17:39 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 07:17:39 user nova-compute[75293]:         </nova:port>
Nov 30 07:17:39 user nova-compute[75293]:       </nova:ports>
Nov 30 07:17:39 user nova-compute[75293]:     </nova:instance>
Nov 30 07:17:39 user nova-compute[75293]:   </metadata>
Nov 30 07:17:39 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:17:39 user nova-compute[75293]:     <system>
Nov 30 07:17:39 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:17:39 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:17:39 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:17:39 user nova-compute[75293]:       <entry name="serial">04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7</entry>
Nov 30 07:17:39 user nova-compute[75293]:       <entry name="uuid">04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7</entry>
Nov 30 07:17:39 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:17:39 user nova-compute[75293]:     </system>
Nov 30 07:17:39 user nova-compute[75293]:   </sysinfo>
Nov 30 07:17:39 user nova-compute[75293]:   <os>
Nov 30 07:17:39 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:17:39 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:17:39 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:17:39 user nova-compute[75293]:   </os>
Nov 30 07:17:39 user nova-compute[75293]:   <features>
Nov 30 07:17:39 user nova-compute[75293]:     <acpi/>
Nov 30 07:17:39 user nova-compute[75293]:     <apic/>
Nov 30 07:17:39 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:17:39 user nova-compute[75293]:   </features>
Nov 30 07:17:39 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:17:39 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:17:39 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:17:39 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:17:39 user nova-compute[75293]:   </clock>
Nov 30 07:17:39 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:17:39 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:17:39 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:17:39 user nova-compute[75293]:   </cpu>
Nov 30 07:17:39 user nova-compute[75293]:   <devices>
Nov 30 07:17:39 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:17:39 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:17:39 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/disk"/>
Nov 30 07:17:39 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:17:39 user nova-compute[75293]:     </disk>
Nov 30 07:17:39 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:17:39 user nova-compute[75293]:       <mac address="fa:16:3e:d0:1c:74"/>
Nov 30 07:17:39 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:17:39 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:17:39 user nova-compute[75293]:       <target dev="tapdae8d2c1-7b"/>
Nov 30 07:17:39 user nova-compute[75293]:     </interface>
Nov 30 07:17:39 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:17:39 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/console.log" append="off"/>
Nov 30 07:17:39 user nova-compute[75293]:     </serial>
Nov 30 07:17:39 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:17:39 user nova-compute[75293]:     <video>
Nov 30 07:17:39 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:17:39 user nova-compute[75293]:     </video>
Nov 30 07:17:39 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:17:39 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:17:39 user nova-compute[75293]:     </rng>
Nov 30 07:17:39 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:17:39 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:17:39 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:17:39 user nova-compute[75293]:     </memballoon>
Nov 30 07:17:39 user nova-compute[75293]:   </devices>
Nov 30 07:17:39 user nova-compute[75293]: </domain>
Nov 30 07:17:39 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-194695443',display_name='tempest-TestStampPattern-server-194695443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-194695443',id=30,image_ref='50d27170-e54d-40e0-9d79-31e4ded1fe5d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0qMxl7UVzzNRBhKaK7jCT6r/53GRkB3Di+2AcuMeqPobnGiie2ivpr0tiN4y2/+N5eqEzUQwswDBS+N1ym58HFieIzNbbIOVxlbtYOwXvyj9jGINm6Alzpe31PR/dT3g==',key_name='tempest-TestStampPattern-1639076054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3973d2dcb7674ea5b11eb2007f26df78',ramdisk_id='',reservation_id='r-bthdhn49',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d34f99fc-343e-4e8a-83e6-372b0326bded',image_min_disk='1',image_min_ram='0',image_owner_id='3973d2dcb7674ea5b11eb2007f26df78',image_owner_project_name='tempest-TestStampPattern-1058543327',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1058543327-project-member',image_user_id='bec86b562bb54d7c9e10d8ce99723460',network_allocated='True',owner_project_name='tempest-TestStampPattern-1058543327',owner_user_name='tempest-TestStampPattern-1058543327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:17:37Z,user_data=None,user_id='bec86b562bb54d7c9e10d8ce99723460',uuid=04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dae8d2c1-7bef-420e-b14b-911f6552261b", "address": "fa:16:3e:d0:1c:74", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae8d2c1-7b", "ovs_interfaceid": "dae8d2c1-7bef-420e-b14b-911f6552261b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Converting VIF {"id": "dae8d2c1-7bef-420e-b14b-911f6552261b", "address": "fa:16:3e:d0:1c:74", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae8d2c1-7b", "ovs_interfaceid": "dae8d2c1-7bef-420e-b14b-911f6552261b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=dae8d2c1-7bef-420e-b14b-911f6552261b,network=Network(bab4085c-ab04-4e03-912e-6c6c8fde90b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae8d2c1-7b') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG os_vif [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=dae8d2c1-7bef-420e-b14b-911f6552261b,network=Network(bab4085c-ab04-4e03-912e-6c6c8fde90b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae8d2c1-7b') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa35094b-55c4-5b90-a8d0-bc51059c66ac', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdae8d2c1-7b, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdae8d2c1-7b, col_values=(('qos', UUID('f5c35965-c236-4173-bbfa-0508b8d78a6f')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdae8d2c1-7b, col_values=(('external_ids', {'iface-id': 'dae8d2c1-7bef-420e-b14b-911f6552261b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:1c:74', 'vm-uuid': '04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:39 user nova-compute[75293]: INFO os_vif [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=dae8d2c1-7bef-420e-b14b-911f6552261b,network=Network(bab4085c-ab04-4e03-912e-6c6c8fde90b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae8d2c1-7b')
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:17:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] No VIF found with MAC fa:16:3e:d0:1c:74, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:17:40 user nova-compute[75293]: DEBUG nova.network.neutron [req-79927792-b990-4c82-9cf6-67488ed5a409 req-f609db0b-c977-4d26-9c9d-fcddcc633cf4 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Updated VIF entry in instance network info cache for port dae8d2c1-7bef-420e-b14b-911f6552261b. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:17:40 user nova-compute[75293]: DEBUG nova.network.neutron [req-79927792-b990-4c82-9cf6-67488ed5a409 req-f609db0b-c977-4d26-9c9d-fcddcc633cf4 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Updating instance_info_cache with network_info: [{"id": "dae8d2c1-7bef-420e-b14b-911f6552261b", "address": "fa:16:3e:d0:1c:74", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae8d2c1-7b", "ovs_interfaceid": "dae8d2c1-7bef-420e-b14b-911f6552261b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:17:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-79927792-b990-4c82-9cf6-67488ed5a409 req-f609db0b-c977-4d26-9c9d-fcddcc633cf4 service nova] Releasing lock "refresh_cache-04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:17:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:41 user nova-compute[75293]: DEBUG nova.compute.manager [req-865ea4fc-1c44-412c-a84c-0dcd6a2e920a req-dd516fde-33f1-4a46-bd01-0caa4f3072ca service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Received event network-vif-plugged-dae8d2c1-7bef-420e-b14b-911f6552261b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-865ea4fc-1c44-412c-a84c-0dcd6a2e920a req-dd516fde-33f1-4a46-bd01-0caa4f3072ca service nova] Acquiring lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-865ea4fc-1c44-412c-a84c-0dcd6a2e920a req-dd516fde-33f1-4a46-bd01-0caa4f3072ca service nova] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-865ea4fc-1c44-412c-a84c-0dcd6a2e920a req-dd516fde-33f1-4a46-bd01-0caa4f3072ca service nova] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:41 user nova-compute[75293]: DEBUG nova.compute.manager [req-865ea4fc-1c44-412c-a84c-0dcd6a2e920a req-dd516fde-33f1-4a46-bd01-0caa4f3072ca service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] No waiting events found dispatching network-vif-plugged-dae8d2c1-7bef-420e-b14b-911f6552261b {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:17:41 user nova-compute[75293]: WARNING nova.compute.manager [req-865ea4fc-1c44-412c-a84c-0dcd6a2e920a req-dd516fde-33f1-4a46-bd01-0caa4f3072ca service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Received unexpected event network-vif-plugged-dae8d2c1-7bef-420e-b14b-911f6552261b for instance with vm_state building and task_state spawning.
Nov 30 07:17:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:41 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:17:41 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75293) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 07:17:43 user nova-compute[75293]: DEBUG nova.compute.manager [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:17:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:17:43 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Instance spawned successfully.
Nov 30 07:17:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:17:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:17:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-88868565-681e-4fec-9f8b-0f2ed7826342 req-b1f0606c-e857-4ff0-9819-772ffa544d13 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Received event network-vif-plugged-dae8d2c1-7bef-420e-b14b-911f6552261b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-88868565-681e-4fec-9f8b-0f2ed7826342 req-b1f0606c-e857-4ff0-9819-772ffa544d13 service nova] Acquiring lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-88868565-681e-4fec-9f8b-0f2ed7826342 req-b1f0606c-e857-4ff0-9819-772ffa544d13 service nova] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-88868565-681e-4fec-9f8b-0f2ed7826342 req-b1f0606c-e857-4ff0-9819-772ffa544d13 service nova] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-88868565-681e-4fec-9f8b-0f2ed7826342 req-b1f0606c-e857-4ff0-9819-772ffa544d13 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] No waiting events found dispatching network-vif-plugged-dae8d2c1-7bef-420e-b14b-911f6552261b {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:17:43 user nova-compute[75293]: WARNING nova.compute.manager [req-88868565-681e-4fec-9f8b-0f2ed7826342 req-b1f0606c-e857-4ff0-9819-772ffa544d13 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Received unexpected event network-vif-plugged-dae8d2c1-7bef-420e-b14b-911f6552261b for instance with vm_state building and task_state spawning.
Nov 30 07:17:44 user nova-compute[75293]: INFO nova.compute.manager [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Took 7.04 seconds to spawn the instance on the hypervisor.
Nov 30 07:17:44 user nova-compute[75293]: DEBUG nova.compute.manager [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:17:44 user nova-compute[75293]: INFO nova.compute.manager [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Took 8.02 seconds to build instance.
Nov 30 07:17:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-459664ce-fc78-4b0b-befe-49a0c16660ed tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.123s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:45 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:17:45 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Cleaning up deleted instances {{(pid=75293) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 07:17:45 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] There are 0 instances to clean {{(pid=75293) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 07:17:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:50 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:17:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:52 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:17:52 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:17:53 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:17:53 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:17:53 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Rebuilding the list of instances to heal {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 07:17:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-1b7deb0a-39af-4d93-b93d-5765a731f702" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:17:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-1b7deb0a-39af-4d93-b93d-5765a731f702" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:17:53 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:17:53 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lazy-loading 'info_cache' on Instance uuid 1b7deb0a-39af-4d93-b93d-5765a731f702 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:17:54 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Updating instance_info_cache with network_info: [{"id": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "address": "fa:16:3e:bb:63:ac", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f5514b-92", "ovs_interfaceid": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:17:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-1b7deb0a-39af-4d93-b93d-5765a731f702" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:17:54 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:17:54 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:17:54 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:17:54 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:17:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:54 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:17:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:55 user nova-compute[75293]: DEBUG nova.compute.manager [req-16486c8e-921d-46d8-9ef7-879f5f372668 req-d95863e9-2ea7-43ee-bc48-76adf6f1f033 service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Received event network-changed-cbfcdcde-3eb5-4718-9e72-f0bc28211827 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:17:55 user nova-compute[75293]: DEBUG nova.compute.manager [req-16486c8e-921d-46d8-9ef7-879f5f372668 req-d95863e9-2ea7-43ee-bc48-76adf6f1f033 service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Refreshing instance network info cache due to event network-changed-cbfcdcde-3eb5-4718-9e72-f0bc28211827. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:17:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-16486c8e-921d-46d8-9ef7-879f5f372668 req-d95863e9-2ea7-43ee-bc48-76adf6f1f033 service nova] Acquiring lock "refresh_cache-a46f0c4f-4449-47e2-aa1e-a4508c81d768" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:17:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-16486c8e-921d-46d8-9ef7-879f5f372668 req-d95863e9-2ea7-43ee-bc48-76adf6f1f033 service nova] Acquired lock "refresh_cache-a46f0c4f-4449-47e2-aa1e-a4508c81d768" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:17:55 user nova-compute[75293]: DEBUG nova.network.neutron [req-16486c8e-921d-46d8-9ef7-879f5f372668 req-d95863e9-2ea7-43ee-bc48-76adf6f1f033 service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Refreshing network info cache for port cbfcdcde-3eb5-4718-9e72-f0bc28211827 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:17:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG nova.network.neutron [req-16486c8e-921d-46d8-9ef7-879f5f372668 req-d95863e9-2ea7-43ee-bc48-76adf6f1f033 service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Updated VIF entry in instance network info cache for port cbfcdcde-3eb5-4718-9e72-f0bc28211827. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG nova.network.neutron [req-16486c8e-921d-46d8-9ef7-879f5f372668 req-d95863e9-2ea7-43ee-bc48-76adf6f1f033 service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Updating instance_info_cache with network_info: [{"id": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "address": "fa:16:3e:57:b9:0d", "network": {"id": "a1600e76-0910-4c90-8474-0f0152873c7e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1517603206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2bfbd8ed6e440cae055aa384db6ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfcdcde-3e", "ovs_interfaceid": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-16486c8e-921d-46d8-9ef7-879f5f372668 req-d95863e9-2ea7-43ee-bc48-76adf6f1f033 service nova] Releasing lock "refresh_cache-a46f0c4f-4449-47e2-aa1e-a4508c81d768" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG nova.objects.instance [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lazy-loading 'flavor' on Instance uuid a46f0c4f-4449-47e2-aa1e-a4508c81d768 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:56 user nova-compute[75293]: INFO nova.compute.manager [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Attaching volume aa215221-be93-4787-b37f-56937b1e2238 to /dev/vdb
Nov 30 07:17:56 user nova-compute[75293]: DEBUG os_brick.utils [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bc3ec8-f58d-4648-a238-472af8c6abfb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4cfd36-5b96-4e77-a903-9ee2b2b6f87c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b6c693-a18e-45ae-8c43-8bd3a1802b43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[724efc9b-b0ab-467e-9032-326f8d65c842]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:17:57 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:17:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b21d29-0981-4562-9f10-4ecd99ca2ae3]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG os_brick.utils [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Updating existing volume attachment record: 113046d5-f5b9-4013-a9e6-70aab8e1149a {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b9424a3-3053-4b8f-9eb9-5c81944a8fd5/disk.rescue --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b9424a3-3053-4b8f-9eb9-5c81944a8fd5/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b9424a3-3053-4b8f-9eb9-5c81944a8fd5/disk.rescue --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b9424a3-3053-4b8f-9eb9-5c81944a8fd5/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:17:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:17:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:59 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:17:59 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=7021MB free_disk=24.86872100830078GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "677602ec-88fd-4026-8112-8469855f8a78" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "677602ec-88fd-4026-8112-8469855f8a78" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:17:59 user nova-compute[75293]: INFO nova.compute.manager [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Unshelving
Nov 30 07:17:59 user nova-compute[75293]: INFO nova.virt.block_device [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Booting with volume 9f2b1463-7536-4ea8-9576-419ceeeb8314 at /dev/vda
Nov 30 07:17:59 user nova-compute[75293]: DEBUG os_brick.utils [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2819339d-6302-4481-8378-30c6e38406af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b7deb0a-39af-4d93-b93d-5765a731f702 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance c8d1df78-2aa2-4710-a570-5f72c60cfc26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9295d423-d71c-436b-9306-e0b386a0011f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance d34f99fc-343e-4e8a-83e6-372b0326bded actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 093deaa6-a68c-4688-9055-69dda63b6b4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 4be43bb1-b17c-40b9-953a-c820f2396176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance ed037c80-4f33-4e03-907c-18b4ea122411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance a46f0c4f-4449-47e2-aa1e-a4508c81d768 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 821af6a7-0ab8-4947-afaf-e97b2b781375 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance f5162965-1cf1-4f92-86fc-88c1004748c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2705e35e-3696-4367-974e-7c77da8ecdf9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 677602ec-88fd-4026-8112-8469855f8a78 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[60441260-dec9-423d-9785-458c7edbca1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81f1027-89e4-453e-80bc-f1af90cc3550]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Refreshing inventories for resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:17:59 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:17:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8001eb89-ae21-46f8-bfda-d0ebaf49ba33]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG os_brick.utils [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Updating existing volume attachment record: 38816e68-e756-43a0-8bd8-eac9cfb8cea0 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Updating ProviderTree inventory for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Updating inventory in ProviderTree for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Refreshing aggregate associations for resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa, aggregates: None {{(pid=75293) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 07:17:59 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Refreshing trait associations for resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV {{(pid=75293) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 07:18:00 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:18:00 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:18:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:18:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.838s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:00 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:18:00 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:18:00 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:18:00 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:18:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zqHYUPsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:18:05 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:18:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:18:05 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:18:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:18:05 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d22e70-b8ac-4540-a29f-b05fd110f71f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:18:05 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b2fcb4-3103-4813-98aa-8bef307ee4f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238] added
Nov 30 07:18:05 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfb8d66-b342-4f78-ae91-ccbb0271820c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee97fd69-3cc6-4fb5-9a7e-ce44efb48710]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zqHYUPsx {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zqHYUPsx" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b4abff-7bee-4241-88b9-18a603775f0f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zqHYUPsx'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[221b1757-9d8a-4a16-bba2-258bb148d7d6]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e201a2-0bb0-4271-8b9f-0f5fc6a64b63]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ae9d0b-0810-4061-8bd5-fcee9314c60b (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:18:05 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:18:05 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:18:05 user nova-compute[75293]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:18:05 user nova-compute[75293]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ae9d0b-0810-4061-8bd5-fcee9314c60b (non-flash)
Nov 30 07:18:05 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:18:05 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:18:05 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:18:05 user nova-compute[75293]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:18:05 user nova-compute[75293]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ae9d0b-0810-4061-8bd5-fcee9314c60b (non-flash)
Nov 30 07:18:05 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:18:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7356cd62-270b-45c1-9091-337540e4aede]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238, portal: 172.16.0.220,3260]
Nov 30 07:18:06 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238, portal: 172.16.0.220,3260] successful.
Nov 30 07:18:06 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72c78ad-8638-46ce-82f9-866625a482c1]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64cb83d-2c57-44b1-b5bc-1f9ad163533b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ae9d0b-0810-4061-8bd5-fcee9314c60b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:18:06 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:18:06 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:18:06 user nova-compute[75293]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:18:06 user nova-compute[75293]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ae9d0b-0810-4061-8bd5-fcee9314c60b (non-flash)
Nov 30 07:18:06 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:18:06 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:18:06 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:18:06 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:18:06 user nova-compute[75293]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:18:06 user nova-compute[75293]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ae9d0b-0810-4061-8bd5-fcee9314c60b (non-flash)
Nov 30 07:18:06 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:18:06 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f5985b-0fe3-4cd3-a193-48c6a49eca12]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zqHYUPsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:18:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:18:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23062346366303365', 'path': '/dev/sdg'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:18:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062346366303365', 'path': '/dev/sdg'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:18:07 user nova-compute[75293]: DEBUG nova.objects.instance [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lazy-loading 'flavor' on Instance uuid a46f0c4f-4449-47e2-aa1e-a4508c81d768 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:18:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:18:07 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:18:07 user nova-compute[75293]:   <source dev="/dev/sdg"/>
Nov 30 07:18:07 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:18:07 user nova-compute[75293]:   <serial>aa215221-be93-4787-b37f-56937b1e2238</serial>
Nov 30 07:18:07 user nova-compute[75293]: </disk>
Nov 30 07:18:07 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:18:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:18:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:18:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] No VIF found with MAC fa:16:3e:57:b9:0d, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:18:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-df53ae71-aa0f-4ea7-90be-32dd58e23a01 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.881s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:08 user nova-compute[75293]: DEBUG nova.objects.instance [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lazy-loading 'pci_requests' on Instance uuid 677602ec-88fd-4026-8112-8469855f8a78 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:18:08 user nova-compute[75293]: DEBUG nova.objects.instance [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lazy-loading 'numa_topology' on Instance uuid 677602ec-88fd-4026-8112-8469855f8a78 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:18:08 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:18:08 user nova-compute[75293]: INFO nova.compute.claims [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Claim successful on node user
Nov 30 07:18:09 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:18:09 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:18:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.607s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:09 user nova-compute[75293]: INFO nova.network.neutron [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Updating port 814f9aa9-6974-4b76-96ba-52668f19b3f1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 30 07:18:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquired lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.compute.manager [req-82ceaedd-0089-4f3a-ad76-2ad3705a44c9 req-109dee19-fbdb-4ac1-814e-a2289a15f77e service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received event network-changed-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.compute.manager [req-82ceaedd-0089-4f3a-ad76-2ad3705a44c9 req-109dee19-fbdb-4ac1-814e-a2289a15f77e service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Refreshing instance network info cache due to event network-changed-814f9aa9-6974-4b76-96ba-52668f19b3f1. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-82ceaedd-0089-4f3a-ad76-2ad3705a44c9 req-109dee19-fbdb-4ac1-814e-a2289a15f77e service nova] Acquiring lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Updating instance_info_cache with network_info: [{"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Releasing lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:18:10 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Creating image(s)
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Did not create local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Ensure instance console log exists: /opt/stack/data/nova/instances/677602ec-88fd-4026-8112-8469855f8a78/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Start _get_guest_xml network_info=[{"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YnWrPTdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '677602ec-88fd-4026-8112-8469855f8a78', 'attached_at': '', 'detached_at': '', 'volume_id': '9f2b1463-7536-4ea8-9576-419ceeeb8314', 'serial': '9f2b1463-7536-4ea8-9576-419ceeeb8314'}, 'delete_on_termination': True, 'attachment_id': '38816e68-e756-43a0-8bd8-eac9cfb8cea0', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-82ceaedd-0089-4f3a-ad76-2ad3705a44c9 req-109dee19-fbdb-4ac1-814e-a2289a15f77e service nova] Acquired lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.network.neutron [req-82ceaedd-0089-4f3a-ad76-2ad3705a44c9 req-109dee19-fbdb-4ac1-814e-a2289a15f77e service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Refreshing network info cache for port 814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:18:10 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:18:10 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.objects.instance [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lazy-loading 'vcpu_model' on Instance uuid 677602ec-88fd-4026-8112-8469855f8a78 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.objects.base [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Object Instance<677602ec-88fd-4026-8112-8469855f8a78> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YnWrPTdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:18:10 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:18:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:18:10 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:18:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:18:10 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6221fc91-49dd-441b-800c-9098e921f759]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:18:10 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc20822-e723-4581-8b06-5365b687e21d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314] added
Nov 30 07:18:10 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce1a47b-b164-422f-8193-5d17fbbd4c63]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[962c0fa5-dbba-42f8-883c-d419f3bdbd8e]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YnWrPTdx {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YnWrPTdx" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4327415b-d273-4562-a9db-5e4dc696b8ea]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YnWrPTdx'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9c215b-9fb2-443a-a1bc-651409a926fa]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b028a73-d7da-4c14-a8c5-9df7d880c976]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ae9d0b-0810-4061-8bd5-fcee9314c60b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:18:10 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:18:10 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:18:10 user nova-compute[75293]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:18:10 user nova-compute[75293]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ae9d0b-0810-4061-8bd5-fcee9314c60b (non-flash)
Nov 30 07:18:10 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:18:10 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:18:10 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:18:10 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:18:10 user nova-compute[75293]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:18:10 user nova-compute[75293]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ae9d0b-0810-4061-8bd5-fcee9314c60b (non-flash)
Nov 30 07:18:10 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:18:10 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4929f2-3376-4e98-988f-3694c701ab47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:10 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314, portal: 172.16.0.220,3260]
Nov 30 07:18:10 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314, portal: 172.16.0.220,3260] successful.
Nov 30 07:18:10 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fe1bba-caf2-44fc-bd34-353447cfac5e]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[835400df-3041-43cc-b8f6-1282d64fdbfb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ae9d0b-0810-4061-8bd5-fcee9314c60b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:18:11 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:18:11 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:18:11 user nova-compute[75293]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:18:11 user nova-compute[75293]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ae9d0b-0810-4061-8bd5-fcee9314c60b (non-flash)
Nov 30 07:18:11 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:18:11 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:18:11 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:18:11 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:18:11 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:18:11 user nova-compute[75293]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:18:11 user nova-compute[75293]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ae9d0b-0810-4061-8bd5-fcee9314c60b (non-flash)
Nov 30 07:18:11 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:18:11 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:18:11 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.410s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] HCTL ('39', '-', '-', 0) found on session 34 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[416361b1-9a18-40e1-a9d3-2fbc2b915256]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Searching for a device in session 34 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YnWrPTdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG nova.network.neutron [req-82ceaedd-0089-4f3a-ad76-2ad3705a44c9 req-109dee19-fbdb-4ac1-814e-a2289a15f77e service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Updated VIF entry in instance network info cache for port 814f9aa9-6974-4b76-96ba-52668f19b3f1. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG nova.network.neutron [req-82ceaedd-0089-4f3a-ad76-2ad3705a44c9 req-109dee19-fbdb-4ac1-814e-a2289a15f77e service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Updating instance_info_cache with network_info: [{"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-82ceaedd-0089-4f3a-ad76-2ad3705a44c9 req-109dee19-fbdb-4ac1-814e-a2289a15f77e service nova] Releasing lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-f5579bca-88d9-4a09-b1bb-819d1eb95263 req-1721ff10-44db-4c9c-8597-eb20e5f7660f service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received event network-changed-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-f5579bca-88d9-4a09-b1bb-819d1eb95263 req-1721ff10-44db-4c9c-8597-eb20e5f7660f service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Refreshing instance network info cache due to event network-changed-4367d997-9d95-45a9-9a95-ddb8a27595c6. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f5579bca-88d9-4a09-b1bb-819d1eb95263 req-1721ff10-44db-4c9c-8597-eb20e5f7660f service nova] Acquiring lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f5579bca-88d9-4a09-b1bb-819d1eb95263 req-1721ff10-44db-4c9c-8597-eb20e5f7660f service nova] Acquired lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG nova.network.neutron [req-f5579bca-88d9-4a09-b1bb-819d1eb95263 req-1721ff10-44db-4c9c-8597-eb20e5f7660f service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Refreshing network info cache for port 4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG nova.network.neutron [req-f5579bca-88d9-4a09-b1bb-819d1eb95263 req-1721ff10-44db-4c9c-8597-eb20e5f7660f service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Updated VIF entry in instance network info cache for port 4367d997-9d95-45a9-9a95-ddb8a27595c6. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG nova.network.neutron [req-f5579bca-88d9-4a09-b1bb-819d1eb95263 req-1721ff10-44db-4c9c-8597-eb20e5f7660f service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Updating instance_info_cache with network_info: [{"id": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "address": "fa:16:3e:93:db:1e", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4367d997-9d", "ovs_interfaceid": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f5579bca-88d9-4a09-b1bb-819d1eb95263 req-1721ff10-44db-4c9c-8597-eb20e5f7660f service nova] Releasing lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "39042069-ac9b-4b13-b486-c845e84ac041" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "39042069-ac9b-4b13-b486-c845e84ac041" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:11 user nova-compute[75293]: INFO nova.compute.manager [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Unshelving
Nov 30 07:18:12 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.463s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '23132346530656130', 'path': '/dev/sdh'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132346530656130', 'path': '/dev/sdh'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG nova.objects.instance [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'pci_requests' on Instance uuid 39042069-ac9b-4b13-b486-c845e84ac041 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG nova.objects.instance [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'numa_topology' on Instance uuid 39042069-ac9b-4b13-b486-c845e84ac041 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T07:14:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-770610968',display_name='tempest-TestShelveInstance-server-770610968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-770610968',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-816209512',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:14:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bb68dc3daea04910bc7f11d6acdd91a6',ramdisk_id='',reservation_id='r-u75fgbpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-620093432',owner_user_name='tempest-TestShelveInstance-620093432-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:18:00Z,user_data=None,user_id='1470bbdb1f494cca880294d2e97d3a01',uuid=677602ec-88fd-4026-8112-8469855f8a78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Converting VIF {"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=814f9aa9-6974-4b76-96ba-52668f19b3f1,network=Network(c9521d26-96fd-4c02-88a6-c6cc9d945905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f9aa9-69') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG nova.objects.instance [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lazy-loading 'pci_devices' on Instance uuid 677602ec-88fd-4026-8112-8469855f8a78 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:18:12 user nova-compute[75293]: INFO nova.compute.claims [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Claim successful on node user
Nov 30 07:18:12 user nova-compute[75293]: DEBUG nova.objects.base [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Object Instance<677602ec-88fd-4026-8112-8469855f8a78> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:18:12 user nova-compute[75293]:   <uuid>677602ec-88fd-4026-8112-8469855f8a78</uuid>
Nov 30 07:18:12 user nova-compute[75293]:   <name>instance-00000013</name>
Nov 30 07:18:12 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:18:12 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:18:12 user nova-compute[75293]:   <metadata>
Nov 30 07:18:12 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:18:12 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:18:12 user nova-compute[75293]:       <nova:name>tempest-TestShelveInstance-server-770610968</nova:name>
Nov 30 07:18:12 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:18:10</nova:creationTime>
Nov 30 07:18:12 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:18:12 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:18:12 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:18:12 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:18:12 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:18:12 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:18:12 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:18:12 user nova-compute[75293]:       <nova:owner>
Nov 30 07:18:12 user nova-compute[75293]:         <nova:user uuid="1470bbdb1f494cca880294d2e97d3a01">tempest-TestShelveInstance-620093432-project-member</nova:user>
Nov 30 07:18:12 user nova-compute[75293]:         <nova:project uuid="bb68dc3daea04910bc7f11d6acdd91a6">tempest-TestShelveInstance-620093432</nova:project>
Nov 30 07:18:12 user nova-compute[75293]:       </nova:owner>
Nov 30 07:18:12 user nova-compute[75293]:       <nova:ports>
Nov 30 07:18:12 user nova-compute[75293]:         <nova:port uuid="814f9aa9-6974-4b76-96ba-52668f19b3f1">
Nov 30 07:18:12 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 30 07:18:12 user nova-compute[75293]:         </nova:port>
Nov 30 07:18:12 user nova-compute[75293]:       </nova:ports>
Nov 30 07:18:12 user nova-compute[75293]:     </nova:instance>
Nov 30 07:18:12 user nova-compute[75293]:   </metadata>
Nov 30 07:18:12 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:18:12 user nova-compute[75293]:     <system>
Nov 30 07:18:12 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:18:12 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:18:12 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:18:12 user nova-compute[75293]:       <entry name="serial">677602ec-88fd-4026-8112-8469855f8a78</entry>
Nov 30 07:18:12 user nova-compute[75293]:       <entry name="uuid">677602ec-88fd-4026-8112-8469855f8a78</entry>
Nov 30 07:18:12 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:18:12 user nova-compute[75293]:     </system>
Nov 30 07:18:12 user nova-compute[75293]:   </sysinfo>
Nov 30 07:18:12 user nova-compute[75293]:   <os>
Nov 30 07:18:12 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:18:12 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:18:12 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:18:12 user nova-compute[75293]:   </os>
Nov 30 07:18:12 user nova-compute[75293]:   <features>
Nov 30 07:18:12 user nova-compute[75293]:     <acpi/>
Nov 30 07:18:12 user nova-compute[75293]:     <apic/>
Nov 30 07:18:12 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:18:12 user nova-compute[75293]:   </features>
Nov 30 07:18:12 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:18:12 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:18:12 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:18:12 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:18:12 user nova-compute[75293]:   </clock>
Nov 30 07:18:12 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:18:12 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:18:12 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:18:12 user nova-compute[75293]:   </cpu>
Nov 30 07:18:12 user nova-compute[75293]:   <devices>
Nov 30 07:18:12 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:18:12 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:18:12 user nova-compute[75293]:       <source dev="/dev/sdh"/>
Nov 30 07:18:12 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:18:12 user nova-compute[75293]:       <serial>9f2b1463-7536-4ea8-9576-419ceeeb8314</serial>
Nov 30 07:18:12 user nova-compute[75293]:     </disk>
Nov 30 07:18:12 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:18:12 user nova-compute[75293]:       <mac address="fa:16:3e:60:bb:6e"/>
Nov 30 07:18:12 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:18:12 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:18:12 user nova-compute[75293]:       <target dev="tap814f9aa9-69"/>
Nov 30 07:18:12 user nova-compute[75293]:     </interface>
Nov 30 07:18:12 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:18:12 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/677602ec-88fd-4026-8112-8469855f8a78/console.log" append="off"/>
Nov 30 07:18:12 user nova-compute[75293]:     </serial>
Nov 30 07:18:12 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:18:12 user nova-compute[75293]:     <video>
Nov 30 07:18:12 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:18:12 user nova-compute[75293]:     </video>
Nov 30 07:18:12 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:18:12 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:18:12 user nova-compute[75293]:     </rng>
Nov 30 07:18:12 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:18:12 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:18:12 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:18:12 user nova-compute[75293]:     </memballoon>
Nov 30 07:18:12 user nova-compute[75293]:   </devices>
Nov 30 07:18:12 user nova-compute[75293]: </domain>
Nov 30 07:18:12 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T07:14:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-770610968',display_name='tempest-TestShelveInstance-server-770610968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-770610968',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-816209512',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:14:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bb68dc3daea04910bc7f11d6acdd91a6',ramdisk_id='',reservation_id='r-u75fgbpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-620093432',owner_user_name='tempest-TestShelveInstance-620093432-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:18:00Z,user_data=None,user_id='1470bbdb1f494cca880294d2e97d3a01',uuid=677602ec-88fd-4026-8112-8469855f8a78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Converting VIF {"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=814f9aa9-6974-4b76-96ba-52668f19b3f1,network=Network(c9521d26-96fd-4c02-88a6-c6cc9d945905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f9aa9-69') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG os_vif [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=814f9aa9-6974-4b76-96ba-52668f19b3f1,network=Network(c9521d26-96fd-4c02-88a6-c6cc9d945905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f9aa9-69') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d7a99c1-efd7-599c-8cb3-8746cf557f64', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap814f9aa9-69, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap814f9aa9-69, col_values=(('qos', UUID('e7990dc0-06d7-434f-909b-1913b73a479e')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap814f9aa9-69, col_values=(('external_ids', {'iface-id': '814f9aa9-6974-4b76-96ba-52668f19b3f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:bb:6e', 'vm-uuid': '677602ec-88fd-4026-8112-8469855f8a78'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:12 user nova-compute[75293]: INFO os_vif [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=814f9aa9-6974-4b76-96ba-52668f19b3f1,network=Network(c9521d26-96fd-4c02-88a6-c6cc9d945905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f9aa9-69')
Nov 30 07:18:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG nova.objects.instance [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lazy-loading 'flavor' on Instance uuid a46f0c4f-4449-47e2-aa1e-a4508c81d768 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] No VIF found with MAC fa:16:3e:60:bb:6e, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:18:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:13 user nova-compute[75293]: INFO nova.compute.manager [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Attaching volume 3cc31cf3-37e3-47fd-aecc-2e35b815efc7 to /dev/vdc
Nov 30 07:18:13 user nova-compute[75293]: DEBUG nova.compute.manager [req-517a9fab-5c25-49c2-ad2f-66d7d189963d req-13fc904b-9f2c-4ce0-9567-032e7e7910ae service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received event network-changed-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG nova.compute.manager [req-517a9fab-5c25-49c2-ad2f-66d7d189963d req-13fc904b-9f2c-4ce0-9567-032e7e7910ae service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Refreshing instance network info cache due to event network-changed-4367d997-9d95-45a9-9a95-ddb8a27595c6. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-517a9fab-5c25-49c2-ad2f-66d7d189963d req-13fc904b-9f2c-4ce0-9567-032e7e7910ae service nova] Acquiring lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-517a9fab-5c25-49c2-ad2f-66d7d189963d req-13fc904b-9f2c-4ce0-9567-032e7e7910ae service nova] Acquired lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG nova.network.neutron [req-517a9fab-5c25-49c2-ad2f-66d7d189963d req-13fc904b-9f2c-4ce0-9567-032e7e7910ae service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Refreshing network info cache for port 4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG os_brick.utils [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fa93a3-f6a7-4cb1-8b37-86b1c7d12be4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dfa386-7e48-4bb6-a781-66861030c1f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d13cba4-ea8c-4524-9ca0-1a356411036b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24e9c87-d288-4e02-af8e-4fbf87a7e1f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:18:13 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[124118f6-fe72-4fb3-b49a-1ee1a2b70300]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG os_brick.utils [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Updating existing volume attachment record: d13f6bf6-ef24-41e4-81bf-2bb3a33eb2d7 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:18:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.670s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:13 user nova-compute[75293]: INFO nova.network.neutron [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Updating port 0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 30 07:18:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "9295d423-d71c-436b-9306-e0b386a0011f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "9295d423-d71c-436b-9306-e0b386a0011f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:14 user nova-compute[75293]: DEBUG nova.network.neutron [req-517a9fab-5c25-49c2-ad2f-66d7d189963d req-13fc904b-9f2c-4ce0-9567-032e7e7910ae service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Updated VIF entry in instance network info cache for port 4367d997-9d95-45a9-9a95-ddb8a27595c6. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:18:14 user nova-compute[75293]: DEBUG nova.network.neutron [req-517a9fab-5c25-49c2-ad2f-66d7d189963d req-13fc904b-9f2c-4ce0-9567-032e7e7910ae service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Updating instance_info_cache with network_info: [{"id": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "address": "fa:16:3e:93:db:1e", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4367d997-9d", "ovs_interfaceid": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:18:14 user nova-compute[75293]: INFO nova.compute.manager [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Detaching volume a9d31834-8af6-4f2b-b597-74b774d2e19c
Nov 30 07:18:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-517a9fab-5c25-49c2-ad2f-66d7d189963d req-13fc904b-9f2c-4ce0-9567-032e7e7910ae service nova] Releasing lock "refresh_cache-9295d423-d71c-436b-9306-e0b386a0011f" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:18:15 user nova-compute[75293]: INFO nova.virt.block_device [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Attempting to driver detach volume a9d31834-8af6-4f2b-b597-74b774d2e19c from mountpoint /dev/vdb
Nov 30 07:18:15 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Attempting to detach device vdb from instance 9295d423-d71c-436b-9306-e0b386a0011f from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:18:15 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:18:15 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:18:15 user nova-compute[75293]:   <source dev="/dev/sdb"/>
Nov 30 07:18:15 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:18:15 user nova-compute[75293]:   <serial>a9d31834-8af6-4f2b-b597-74b774d2e19c</serial>
Nov 30 07:18:15 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:18:15 user nova-compute[75293]: </disk>
Nov 30 07:18:15 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:18:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-8defc7c7-44e8-41df-8906-f2b9512c7a6e req-0e61a6d2-bd01-429e-8ca5-3fb7d18d3e1c service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received event network-vif-plugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:18:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8defc7c7-44e8-41df-8906-f2b9512c7a6e req-0e61a6d2-bd01-429e-8ca5-3fb7d18d3e1c service nova] Acquiring lock "677602ec-88fd-4026-8112-8469855f8a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8defc7c7-44e8-41df-8906-f2b9512c7a6e req-0e61a6d2-bd01-429e-8ca5-3fb7d18d3e1c service nova] Lock "677602ec-88fd-4026-8112-8469855f8a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8defc7c7-44e8-41df-8906-f2b9512c7a6e req-0e61a6d2-bd01-429e-8ca5-3fb7d18d3e1c service nova] Lock "677602ec-88fd-4026-8112-8469855f8a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-8defc7c7-44e8-41df-8906-f2b9512c7a6e req-0e61a6d2-bd01-429e-8ca5-3fb7d18d3e1c service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] No waiting events found dispatching network-vif-plugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:18:15 user nova-compute[75293]: WARNING nova.compute.manager [req-8defc7c7-44e8-41df-8906-f2b9512c7a6e req-0e61a6d2-bd01-429e-8ca5-3fb7d18d3e1c service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received unexpected event network-vif-plugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 07:18:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:15 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Successfully detached device vdb from instance 9295d423-d71c-436b-9306-e0b386a0011f from the persistent domain config.
Nov 30 07:18:15 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9295d423-d71c-436b-9306-e0b386a0011f from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:18:15 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:18:15 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:18:15 user nova-compute[75293]:   <source dev="/dev/sdb"/>
Nov 30 07:18:15 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:18:15 user nova-compute[75293]:   <serial>a9d31834-8af6-4f2b-b597-74b774d2e19c</serial>
Nov 30 07:18:15 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:18:15 user nova-compute[75293]: </disk>
Nov 30 07:18:15 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:18:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:18:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquired lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:18:15 user nova-compute[75293]: DEBUG nova.network.neutron [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:18:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-e97cc007-6622-4165-b113-93b7b504d34b req-ad5f7029-a293-4b86-b85e-33bfeec3bd2d service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received event network-changed-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:18:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-e97cc007-6622-4165-b113-93b7b504d34b req-ad5f7029-a293-4b86-b85e-33bfeec3bd2d service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Refreshing instance network info cache due to event network-changed-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:18:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e97cc007-6622-4165-b113-93b7b504d34b req-ad5f7029-a293-4b86-b85e-33bfeec3bd2d service nova] Acquiring lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:18:15 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9295d423-d71c-436b-9306-e0b386a0011f {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:18:16 user nova-compute[75293]: DEBUG nova.network.neutron [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Updating instance_info_cache with network_info: [{"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:18:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Releasing lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:18:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:18:16 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Creating image(s)
Nov 30 07:18:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "/opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "/opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "/opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:16 user nova-compute[75293]: DEBUG nova.objects.instance [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'trusted_certs' on Instance uuid 39042069-ac9b-4b13-b486-c845e84ac041 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:18:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e97cc007-6622-4165-b113-93b7b504d34b req-ad5f7029-a293-4b86-b85e-33bfeec3bd2d service nova] Acquired lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:18:16 user nova-compute[75293]: DEBUG nova.network.neutron [req-e97cc007-6622-4165-b113-93b7b504d34b req-ad5f7029-a293-4b86-b85e-33bfeec3bd2d service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Refreshing network info cache for port 0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:18:16 user nova-compute[75293]: DEBUG nova.objects.base [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Object Instance<39042069-ac9b-4b13-b486-c845e84ac041> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:18:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "34bf9ff14b0d93477535e952aeab5de0579eac65" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "34bf9ff14b0d93477535e952aeab5de0579eac65" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:16 user nova-compute[75293]: DEBUG nova.network.neutron [req-e97cc007-6622-4165-b113-93b7b504d34b req-ad5f7029-a293-4b86-b85e-33bfeec3bd2d service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Updated VIF entry in instance network info cache for port 0b39fc27-6fcb-4dfe-b948-2d0f4f172b48. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:18:16 user nova-compute[75293]: DEBUG nova.network.neutron [req-e97cc007-6622-4165-b113-93b7b504d34b req-ad5f7029-a293-4b86-b85e-33bfeec3bd2d service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Updating instance_info_cache with network_info: [{"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:18:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e97cc007-6622-4165-b113-93b7b504d34b req-ad5f7029-a293-4b86-b85e-33bfeec3bd2d service nova] Releasing lock "refresh_cache-39042069-ac9b-4b13-b486-c845e84ac041" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:18:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-36a334c8-7d77-48f6-a965-87accdd7f7b7 req-68141363-05a7-4d3a-98b8-3c0d496e54dc service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received event network-vif-plugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:18:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-36a334c8-7d77-48f6-a965-87accdd7f7b7 req-68141363-05a7-4d3a-98b8-3c0d496e54dc service nova] Acquiring lock "677602ec-88fd-4026-8112-8469855f8a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-36a334c8-7d77-48f6-a965-87accdd7f7b7 req-68141363-05a7-4d3a-98b8-3c0d496e54dc service nova] Lock "677602ec-88fd-4026-8112-8469855f8a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-36a334c8-7d77-48f6-a965-87accdd7f7b7 req-68141363-05a7-4d3a-98b8-3c0d496e54dc service nova] Lock "677602ec-88fd-4026-8112-8469855f8a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-36a334c8-7d77-48f6-a965-87accdd7f7b7 req-68141363-05a7-4d3a-98b8-3c0d496e54dc service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] No waiting events found dispatching network-vif-plugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:18:17 user nova-compute[75293]: WARNING nova.compute.manager [req-36a334c8-7d77-48f6-a965-87accdd7f7b7 req-68141363-05a7-4d3a-98b8-3c0d496e54dc service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received unexpected event network-vif-plugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 07:18:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34bf9ff14b0d93477535e952aeab5de0579eac65.part --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:18 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:18:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:18:18 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Instance spawned successfully.
Nov 30 07:18:18 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:18:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d18a7ca8-489c-41ed-9fff-b554b7961cb3 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "677602ec-88fd-4026-8112-8469855f8a78" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.848s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34bf9ff14b0d93477535e952aeab5de0579eac65.part --force-share --output=json" returned: 0 in 0.312s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:18 user nova-compute[75293]: DEBUG nova.virt.images [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] eedea5a5-2f0b-4278-a7d6-cfe8adad5e38 was qcow2, converting to raw {{(pid=75293) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 07:18:18 user nova-compute[75293]: DEBUG nova.privsep.utils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75293) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 07:18:18 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34bf9ff14b0d93477535e952aeab5de0579eac65.part /opt/stack/data/nova/instances/_base/34bf9ff14b0d93477535e952aeab5de0579eac65.converted {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34bf9ff14b0d93477535e952aeab5de0579eac65.part /opt/stack/data/nova/instances/_base/34bf9ff14b0d93477535e952aeab5de0579eac65.converted" returned: 0 in 0.552s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34bf9ff14b0d93477535e952aeab5de0579eac65.converted --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34bf9ff14b0d93477535e952aeab5de0579eac65.converted --force-share --output=json" returned: 0 in 0.253s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "34bf9ff14b0d93477535e952aeab5de0579eac65" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.226s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34bf9ff14b0d93477535e952aeab5de0579eac65 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34bf9ff14b0d93477535e952aeab5de0579eac65 --force-share --output=json" returned: 0 in 0.253s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "34bf9ff14b0d93477535e952aeab5de0579eac65" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "34bf9ff14b0d93477535e952aeab5de0579eac65" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34bf9ff14b0d93477535e952aeab5de0579eac65 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34bf9ff14b0d93477535e952aeab5de0579eac65 --force-share --output=json" returned: 0 in 0.181s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34bf9ff14b0d93477535e952aeab5de0579eac65,backing_fmt=raw /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34bf9ff14b0d93477535e952aeab5de0579eac65,backing_fmt=raw /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk 1073741824" returned: 0 in 0.052s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "34bf9ff14b0d93477535e952aeab5de0579eac65" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34bf9ff14b0d93477535e952aeab5de0579eac65 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:20 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34bf9ff14b0d93477535e952aeab5de0579eac65 --force-share --output=json" returned: 0 in 0.193s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:20 user nova-compute[75293]: DEBUG nova.objects.instance [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'migration_context' on Instance uuid 39042069-ac9b-4b13-b486-c845e84ac041 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:18:20 user nova-compute[75293]: DEBUG nova.objects.base [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Object Instance<39042069-ac9b-4b13-b486-c845e84ac041> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:18:20 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Rebasing disk image.
Nov 30 07:18:20 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:20 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.218s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:20 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 -F raw /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 -F raw /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk" returned: 0 in 2.974s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Ensure instance console log exists: /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Start _get_guest_xml network_info=[{"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='444be1ebc17fe47c518f23e285a7745a',container_format='bare',created_at=2023-11-30T07:16:18Z,direct_url=<?>,disk_format='qcow2',id=eedea5a5-2f0b-4278-a7d6-cfe8adad5e38,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1239175050-shelved',owner='18aa2f5bea3d44ecb10ff083d6f76038',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-30T07:16:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:18:23 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:18:23 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='444be1ebc17fe47c518f23e285a7745a',container_format='bare',created_at=2023-11-30T07:16:18Z,direct_url=<?>,disk_format='qcow2',id=eedea5a5-2f0b-4278-a7d6-cfe8adad5e38,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1239175050-shelved',owner='18aa2f5bea3d44ecb10ff083d6f76038',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-30T07:16:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.objects.instance [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'vcpu_model' on Instance uuid 39042069-ac9b-4b13-b486-c845e84ac041 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.objects.base [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Object Instance<39042069-ac9b-4b13-b486-c845e84ac041> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T07:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1239175050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1239175050',id=20,image_ref='eedea5a5-2f0b-4278-a7d6-cfe8adad5e38',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1386254430',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:14:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='18aa2f5bea3d44ecb10ff083d6f76038',ramdisk_id='',reservation_id='r-j3ig0f6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-763079906',owner_user_name='tempest-AttachVolumeShelveTestJSON-763079906-project-member',shelved_at='2023-11-30T07:16:22.746756',shelved_host='user',shelved_image_id='eedea5a5-2f0b-4278-a7d6-cfe8adad5e38'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e385a89f913645dd9fd2770e6e7445da',uuid=39042069-ac9b-4b13-b486-c845e84ac041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converting VIF {"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=0b39fc27-6fcb-4dfe-b948-2d0f4f172b48,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b39fc27-6f') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.objects.instance [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'pci_devices' on Instance uuid 39042069-ac9b-4b13-b486-c845e84ac041 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.objects.base [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Object Instance<39042069-ac9b-4b13-b486-c845e84ac041> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:18:23 user nova-compute[75293]:   <uuid>39042069-ac9b-4b13-b486-c845e84ac041</uuid>
Nov 30 07:18:23 user nova-compute[75293]:   <name>instance-00000014</name>
Nov 30 07:18:23 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:18:23 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:18:23 user nova-compute[75293]:   <metadata>
Nov 30 07:18:23 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:18:23 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:18:23 user nova-compute[75293]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1239175050</nova:name>
Nov 30 07:18:23 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:18:23</nova:creationTime>
Nov 30 07:18:23 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:18:23 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:18:23 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:18:23 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:18:23 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:18:23 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:18:23 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:18:23 user nova-compute[75293]:       <nova:owner>
Nov 30 07:18:23 user nova-compute[75293]:         <nova:user uuid="e385a89f913645dd9fd2770e6e7445da">tempest-AttachVolumeShelveTestJSON-763079906-project-member</nova:user>
Nov 30 07:18:23 user nova-compute[75293]:         <nova:project uuid="18aa2f5bea3d44ecb10ff083d6f76038">tempest-AttachVolumeShelveTestJSON-763079906</nova:project>
Nov 30 07:18:23 user nova-compute[75293]:       </nova:owner>
Nov 30 07:18:23 user nova-compute[75293]:       <nova:root type="image" uuid="eedea5a5-2f0b-4278-a7d6-cfe8adad5e38"/>
Nov 30 07:18:23 user nova-compute[75293]:       <nova:ports>
Nov 30 07:18:23 user nova-compute[75293]:         <nova:port uuid="0b39fc27-6fcb-4dfe-b948-2d0f4f172b48">
Nov 30 07:18:23 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 07:18:23 user nova-compute[75293]:         </nova:port>
Nov 30 07:18:23 user nova-compute[75293]:       </nova:ports>
Nov 30 07:18:23 user nova-compute[75293]:     </nova:instance>
Nov 30 07:18:23 user nova-compute[75293]:   </metadata>
Nov 30 07:18:23 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:18:23 user nova-compute[75293]:     <system>
Nov 30 07:18:23 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:18:23 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:18:23 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:18:23 user nova-compute[75293]:       <entry name="serial">39042069-ac9b-4b13-b486-c845e84ac041</entry>
Nov 30 07:18:23 user nova-compute[75293]:       <entry name="uuid">39042069-ac9b-4b13-b486-c845e84ac041</entry>
Nov 30 07:18:23 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:18:23 user nova-compute[75293]:     </system>
Nov 30 07:18:23 user nova-compute[75293]:   </sysinfo>
Nov 30 07:18:23 user nova-compute[75293]:   <os>
Nov 30 07:18:23 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:18:23 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:18:23 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:18:23 user nova-compute[75293]:   </os>
Nov 30 07:18:23 user nova-compute[75293]:   <features>
Nov 30 07:18:23 user nova-compute[75293]:     <acpi/>
Nov 30 07:18:23 user nova-compute[75293]:     <apic/>
Nov 30 07:18:23 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:18:23 user nova-compute[75293]:   </features>
Nov 30 07:18:23 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:18:23 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:18:23 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:18:23 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:18:23 user nova-compute[75293]:   </clock>
Nov 30 07:18:23 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:18:23 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:18:23 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:18:23 user nova-compute[75293]:   </cpu>
Nov 30 07:18:23 user nova-compute[75293]:   <devices>
Nov 30 07:18:23 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:18:23 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:18:23 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk"/>
Nov 30 07:18:23 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:18:23 user nova-compute[75293]:     </disk>
Nov 30 07:18:23 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:18:23 user nova-compute[75293]:       <mac address="fa:16:3e:a9:6e:1e"/>
Nov 30 07:18:23 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:18:23 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:18:23 user nova-compute[75293]:       <target dev="tap0b39fc27-6f"/>
Nov 30 07:18:23 user nova-compute[75293]:     </interface>
Nov 30 07:18:23 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:18:23 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/console.log" append="off"/>
Nov 30 07:18:23 user nova-compute[75293]:     </serial>
Nov 30 07:18:23 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:18:23 user nova-compute[75293]:     <video>
Nov 30 07:18:23 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:18:23 user nova-compute[75293]:     </video>
Nov 30 07:18:23 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:18:23 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:18:23 user nova-compute[75293]:     </rng>
Nov 30 07:18:23 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:18:23 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:18:23 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:18:23 user nova-compute[75293]:     </memballoon>
Nov 30 07:18:23 user nova-compute[75293]:   </devices>
Nov 30 07:18:23 user nova-compute[75293]: </domain>
Nov 30 07:18:23 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T07:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1239175050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1239175050',id=20,image_ref='eedea5a5-2f0b-4278-a7d6-cfe8adad5e38',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1386254430',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:14:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='18aa2f5bea3d44ecb10ff083d6f76038',ramdisk_id='',reservation_id='r-j3ig0f6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-763079906',owner_user_name='tempest-AttachVolumeShelveTestJSON-763079906-project-member',shelved_at='2023-11-30T07:16:22.746756',shelved_host='user',shelved_image_id='eedea5a5-2f0b-4278-a7d6-cfe8adad5e38'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e385a89f913645dd9fd2770e6e7445da',uuid=39042069-ac9b-4b13-b486-c845e84ac041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converting VIF {"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=0b39fc27-6fcb-4dfe-b948-2d0f4f172b48,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b39fc27-6f') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG os_vif [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=0b39fc27-6fcb-4dfe-b948-2d0f4f172b48,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b39fc27-6f') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a8a109c4-202a-58e1-9a7a-1263dc55c835', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b39fc27-6f, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b39fc27-6f, col_values=(('qos', UUID('31d0e6b9-719a-4170-8372-0b543bf6ba8e')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b39fc27-6f, col_values=(('external_ids', {'iface-id': '0b39fc27-6fcb-4dfe-b948-2d0f4f172b48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:6e:1e', 'vm-uuid': '39042069-ac9b-4b13-b486-c845e84ac041'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:23 user nova-compute[75293]: INFO os_vif [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=0b39fc27-6fcb-4dfe-b948-2d0f4f172b48,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b39fc27-6f')
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:18:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] No VIF found with MAC fa:16:3e:a9:6e:1e, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VLHoyKsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:18:24 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:18:24 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:18:24 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260" returned: 21 in 0.124s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[83128ad1-4c6e-4bca-a588-bd54ce098ebd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:18:24 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.039s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dea890c-5a27-409f-9ed4-12d5fae2c3b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7] added
Nov 30 07:18:24 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.047s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfa1440-084a-44cf-9d83-1627fc907162]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.089s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61835c9-4f33-4d9f-a521-893cc94bc063]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VLHoyKsT {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VLHoyKsT" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d517bf07-e757-4854-9c56-f339bff3dc2f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VLHoyKsT'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3819bab-f8aa-4186-ba63-8295c5bdb558]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39e38cc-f36d-4505-b2be-7bb0067b6f13]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ae9d0b-0810-4061-8bd5-fcee9314c60b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ae9d0b-0810-4061-8bd5-fcee9314c60b (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:18:24 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ae9d0b-0810-4061-8bd5-fcee9314c60b (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:18:24 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[46550a5c-1a0e-46dc-9e21-765cb3d590d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7, portal: 172.16.0.220,3260]
Nov 30 07:18:24 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7, portal: 172.16.0.220,3260] successful.
Nov 30 07:18:24 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d09256-4d15-4c31-85be-f37adb3ed4ac]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[716f6f11-69dc-474c-baa9-d13693c49795]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ae9d0b-0810-4061-8bd5-fcee9314c60b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ae9d0b-0810-4061-8bd5-fcee9314c60b (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 (non-flash)
Nov 30 07:18:24 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7ae9d0b-0810-4061-8bd5-fcee9314c60b (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:18:24 user nova-compute[75293]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 (non-flash)
Nov 30 07:18:24 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.574s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] HCTL ('40', '-', '-', 0) found on session 35 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e55c78-63b3-4edd-a491-34ae879f6720]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Searching for a device in session 35 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:18:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VLHoyKsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:18:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:25 user nova-compute[75293]: DEBUG nova.compute.manager [req-521a6287-5463-49f7-8b15-ac1650ef359d req-e91737b5-0de9-466f-bc91-f8bb4e4920b1 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received event network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:18:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-521a6287-5463-49f7-8b15-ac1650ef359d req-e91737b5-0de9-466f-bc91-f8bb4e4920b1 service nova] Acquiring lock "39042069-ac9b-4b13-b486-c845e84ac041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-521a6287-5463-49f7-8b15-ac1650ef359d req-e91737b5-0de9-466f-bc91-f8bb4e4920b1 service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-521a6287-5463-49f7-8b15-ac1650ef359d req-e91737b5-0de9-466f-bc91-f8bb4e4920b1 service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:25 user nova-compute[75293]: DEBUG nova.compute.manager [req-521a6287-5463-49f7-8b15-ac1650ef359d req-e91737b5-0de9-466f-bc91-f8bb4e4920b1 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] No waiting events found dispatching network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:18:25 user nova-compute[75293]: WARNING nova.compute.manager [req-521a6287-5463-49f7-8b15-ac1650ef359d req-e91737b5-0de9-466f-bc91-f8bb4e4920b1 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received unexpected event network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 07:18:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.619s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:18:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] <== connect_volume: return (1621ms) {'type': 'block', 'scsi_wwn': '23361356165633462', 'path': '/dev/sdi'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:18:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361356165633462', 'path': '/dev/sdi'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:18:25 user nova-compute[75293]: DEBUG nova.objects.instance [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lazy-loading 'flavor' on Instance uuid a46f0c4f-4449-47e2-aa1e-a4508c81d768 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:18:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:18:25 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:18:25 user nova-compute[75293]:   <source dev="/dev/sdi"/>
Nov 30 07:18:25 user nova-compute[75293]:   <target dev="vdc" bus="virtio"/>
Nov 30 07:18:25 user nova-compute[75293]:   <serial>3cc31cf3-37e3-47fd-aecc-2e35b815efc7</serial>
Nov 30 07:18:25 user nova-compute[75293]: </disk>
Nov 30 07:18:25 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:18:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:18:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:18:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:18:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] No VIF found with MAC fa:16:3e:57:b9:0d, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:18:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-1d71c77d-ecf7-494d-943f-80c3d3a5cf91 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.322s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:27 user nova-compute[75293]: DEBUG nova.compute.manager [req-e97d171a-5e3e-43b3-bf42-053d12198839 req-8996fcbd-30dd-47c2-8e29-0ec15a81b4dc service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received event network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:18:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e97d171a-5e3e-43b3-bf42-053d12198839 req-8996fcbd-30dd-47c2-8e29-0ec15a81b4dc service nova] Acquiring lock "39042069-ac9b-4b13-b486-c845e84ac041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e97d171a-5e3e-43b3-bf42-053d12198839 req-8996fcbd-30dd-47c2-8e29-0ec15a81b4dc service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e97d171a-5e3e-43b3-bf42-053d12198839 req-8996fcbd-30dd-47c2-8e29-0ec15a81b4dc service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:27 user nova-compute[75293]: DEBUG nova.compute.manager [req-e97d171a-5e3e-43b3-bf42-053d12198839 req-8996fcbd-30dd-47c2-8e29-0ec15a81b4dc service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] No waiting events found dispatching network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:18:27 user nova-compute[75293]: WARNING nova.compute.manager [req-e97d171a-5e3e-43b3-bf42-053d12198839 req-8996fcbd-30dd-47c2-8e29-0ec15a81b4dc service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received unexpected event network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 30 07:18:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Acquiring lock "093deaa6-a68c-4688-9055-69dda63b6b4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Acquiring lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:27 user nova-compute[75293]: INFO nova.compute.manager [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Terminating instance
Nov 30 07:18:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:18:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:27 user nova-compute[75293]: INFO nova.compute.manager [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Detaching volume 3cc31cf3-37e3-47fd-aecc-2e35b815efc7
Nov 30 07:18:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:27 user nova-compute[75293]: INFO nova.virt.block_device [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Attempting to driver detach volume 3cc31cf3-37e3-47fd-aecc-2e35b815efc7 from mountpoint /dev/vdc
Nov 30 07:18:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:18:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:18:27 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Instance spawned successfully.
Nov 30 07:18:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Attempting to detach device vdc from instance a46f0c4f-4449-47e2-aa1e-a4508c81d768 from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:18:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:18:27 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:18:27 user nova-compute[75293]:   <source dev="/dev/sdi"/>
Nov 30 07:18:27 user nova-compute[75293]:   <target dev="vdc" bus="virtio"/>
Nov 30 07:18:27 user nova-compute[75293]:   <serial>3cc31cf3-37e3-47fd-aecc-2e35b815efc7</serial>
Nov 30 07:18:27 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 07:18:27 user nova-compute[75293]: </disk>
Nov 30 07:18:27 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:18:27 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Successfully detached device vdc from instance a46f0c4f-4449-47e2-aa1e-a4508c81d768 from the persistent domain config.
Nov 30 07:18:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a46f0c4f-4449-47e2-aa1e-a4508c81d768 from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:18:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:18:27 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:18:27 user nova-compute[75293]:   <source dev="/dev/sdi"/>
Nov 30 07:18:27 user nova-compute[75293]:   <target dev="vdc" bus="virtio"/>
Nov 30 07:18:27 user nova-compute[75293]:   <serial>3cc31cf3-37e3-47fd-aecc-2e35b815efc7</serial>
Nov 30 07:18:27 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 30 07:18:27 user nova-compute[75293]: </disk>
Nov 30 07:18:27 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:18:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG nova.compute.manager [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-54b96299-43b8-45ae-a10e-0fd4d96fac9c tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "39042069-ac9b-4b13-b486-c845e84ac041" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.402s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a46f0c4f-4449-47e2-aa1e-a4508c81d768 {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:28 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Instance destroyed successfully.
Nov 30 07:18:28 user nova-compute[75293]: DEBUG nova.objects.instance [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lazy-loading 'resources' on Instance uuid 093deaa6-a68c-4688-9055-69dda63b6b4c {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T07:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1257820242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1383728389',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkH/W6LW/O9P0TOjpBNyg9mPCr0F5RhJ5UC+vXQMDgOyUkNDLXMoQER4Pxz+57oxrldBInLqlDI69s4mUYzIevfjGRYjiPK6uYw3Yx4XEko0at9i+vwqVvb+4cGOb36ig==',key_name='tempest-keypair-558954396',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:17:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30b1b51e818e442ab5d4b68fede61c3b',ramdisk_id='',reservation_id='r-1o3nhquy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-766996460',owner_user_name='tempest-ServerActionsV293TestJSON-766996460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:17:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9359a918c1394350baf3814eac14c8f6',uuid=093deaa6-a68c-4688-9055-69dda63b6b4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "address": "fa:16:3e:e7:42:bf", "network": {"id": "1c0cc61f-f779-4846-a964-db0ac1ed358a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1209595465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b1b51e818e442ab5d4b68fede61c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b984e7-f1", "ovs_interfaceid": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Converting VIF {"id": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "address": "fa:16:3e:e7:42:bf", "network": {"id": "1c0cc61f-f779-4846-a964-db0ac1ed358a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1209595465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30b1b51e818e442ab5d4b68fede61c3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b984e7-f1", "ovs_interfaceid": "23b984e7-f18d-4c93-9720-0184ff3d6e0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:42:bf,bridge_name='br-int',has_traffic_filtering=True,id=23b984e7-f18d-4c93-9720-0184ff3d6e0a,network=Network(1c0cc61f-f779-4846-a964-db0ac1ed358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b984e7-f1') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG os_vif [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:42:bf,bridge_name='br-int',has_traffic_filtering=True,id=23b984e7-f18d-4c93-9720-0184ff3d6e0a,network=Network(1c0cc61f-f779-4846-a964-db0ac1ed358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b984e7-f1') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23b984e7-f1, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=371082c8-f5b7-4635-8aa9-2cfd5ee314e1) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:28 user nova-compute[75293]: INFO os_vif [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:42:bf,bridge_name='br-int',has_traffic_filtering=True,id=23b984e7-f18d-4c93-9720-0184ff3d6e0a,network=Network(1c0cc61f-f779-4846-a964-db0ac1ed358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b984e7-f1')
Nov 30 07:18:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyFrHfeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:18:28 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:18:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f5918a-af40-49a6-bd65-b621d656be36]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:18:28 user nova-compute[75293]: No targets found.
Nov 30 07:18:28 user nova-compute[75293]: iSNS:
Nov 30 07:18:28 user nova-compute[75293]: No targets found.
Nov 30 07:18:28 user nova-compute[75293]: STATIC:
Nov 30 07:18:28 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0
Nov 30 07:18:28 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:18:28 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:18:28 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c
Nov 30 07:18:28 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:18:28 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:18:28 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238
Nov 30 07:18:28 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:18:28 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:18:28 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314
Nov 30 07:18:28 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:18:28 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:18:28 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:18:28 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:18:28 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:18:28 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7
Nov 30 07:18:28 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:18:28 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:18:28 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db
Nov 30 07:18:28 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:18:28 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:18:28 user nova-compute[75293]: FIRMWARE:
Nov 30 07:18:28 user nova-compute[75293]: No targets found.
Nov 30 07:18:28 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:18:28 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:18:28 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bb2669-b1cb-4bd9-846e-4aa569af9bb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[929c4b2b-b5fd-47ed-bccb-5223025998ac]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:18:28 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:18:28 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:18:28 user nova-compute[75293]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:18:28 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:18:28 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:18:28 user nova-compute[75293]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 (non-flash)
Nov 30 07:18:28 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:18:28 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:18:28 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:18:28 user nova-compute[75293]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db (non-flash)
Nov 30 07:18:28 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:18:28 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:18:28 user nova-compute[75293]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 (non-flash)
Nov 30 07:18:28 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effc866e050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db'): ({'sde'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Removing single pathed devices sde {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1024feb-10ab-4a10-96ab-b17d1aa0e4eb]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf4681a-082f-4731-af95-134b33cf253c]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:28 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Flushing IO for device /dev/sde {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc383e98-8187-4645-94c1-b4fcaf888ad9]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[897e2a03-89d7-42bc-b0ef-4d3cbd829de3]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] SCSI volumes sde have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2235c5fd-a0c7f2fce0df104b', '/dev/disk/by-id/scsi-26130633766326663', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2235c5fd') {{(pid=86417) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fd0f97-b526-4d0d-a552-a641cb8d312b]: (4, None) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9721eaec-0d09-4146-a3da-d5ca366f2d32]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d8524a-40f4-4ed0-b226-801290966af5]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db, portal: 172.16.0.220,3260]
Nov 30 07:18:29 user nova-compute[75293]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db, portal: 172.16.0.220,3260] successful.
Nov 30 07:18:29 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ccb270-8b75-445c-b80f-4af3ec1018db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33b2f39-d155-4431-873a-1a463c6d5d77]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] <== disconnect_volume: return (416ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:18:29 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Deleting instance files /opt/stack/data/nova/instances/093deaa6-a68c-4688-9055-69dda63b6b4c_del
Nov 30 07:18:29 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Deletion of /opt/stack/data/nova/instances/093deaa6-a68c-4688-9055-69dda63b6b4c_del complete
Nov 30 07:18:29 user nova-compute[75293]: INFO nova.compute.manager [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Took 1.62 seconds to destroy the instance on the hypervisor.
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-0d3654be-1317-4528-943f-bd70ae1124eb req-7a89037f-3fa6-4ba1-b9e8-de5490c2ff56 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received event network-vif-unplugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0d3654be-1317-4528-943f-bd70ae1124eb req-7a89037f-3fa6-4ba1-b9e8-de5490c2ff56 service nova] Acquiring lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0d3654be-1317-4528-943f-bd70ae1124eb req-7a89037f-3fa6-4ba1-b9e8-de5490c2ff56 service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0d3654be-1317-4528-943f-bd70ae1124eb req-7a89037f-3fa6-4ba1-b9e8-de5490c2ff56 service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-0d3654be-1317-4528-943f-bd70ae1124eb req-7a89037f-3fa6-4ba1-b9e8-de5490c2ff56 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] No waiting events found dispatching network-vif-unplugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-0d3654be-1317-4528-943f-bd70ae1124eb req-7a89037f-3fa6-4ba1-b9e8-de5490c2ff56 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received event network-vif-unplugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-0d3654be-1317-4528-943f-bd70ae1124eb req-7a89037f-3fa6-4ba1-b9e8-de5490c2ff56 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received event network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0d3654be-1317-4528-943f-bd70ae1124eb req-7a89037f-3fa6-4ba1-b9e8-de5490c2ff56 service nova] Acquiring lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0d3654be-1317-4528-943f-bd70ae1124eb req-7a89037f-3fa6-4ba1-b9e8-de5490c2ff56 service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0d3654be-1317-4528-943f-bd70ae1124eb req-7a89037f-3fa6-4ba1-b9e8-de5490c2ff56 service nova] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-0d3654be-1317-4528-943f-bd70ae1124eb req-7a89037f-3fa6-4ba1-b9e8-de5490c2ff56 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] No waiting events found dispatching network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:18:29 user nova-compute[75293]: WARNING nova.compute.manager [req-0d3654be-1317-4528-943f-bd70ae1124eb req-7a89037f-3fa6-4ba1-b9e8-de5490c2ff56 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received unexpected event network-vif-plugged-23b984e7-f18d-4c93-9720-0184ff3d6e0a for instance with vm_state active and task_state deleting.
Nov 30 07:18:30 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:18:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-ea7100c2-35f6-4e4c-b232-a77bc44a3d4a req-1d0c25c6-f412-4ea5-86a4-e44726450487 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Received event network-vif-deleted-23b984e7-f18d-4c93-9720-0184ff3d6e0a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:18:30 user nova-compute[75293]: INFO nova.compute.manager [req-ea7100c2-35f6-4e4c-b232-a77bc44a3d4a req-1d0c25c6-f412-4ea5-86a4-e44726450487 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Neutron deleted interface 23b984e7-f18d-4c93-9720-0184ff3d6e0a; detaching it from the instance and deleting it from the info cache
Nov 30 07:18:30 user nova-compute[75293]: DEBUG nova.network.neutron [req-ea7100c2-35f6-4e4c-b232-a77bc44a3d4a req-1d0c25c6-f412-4ea5-86a4-e44726450487 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:18:30 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Took 0.79 seconds to deallocate network for instance.
Nov 30 07:18:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-ea7100c2-35f6-4e4c-b232-a77bc44a3d4a req-1d0c25c6-f412-4ea5-86a4-e44726450487 service nova] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Detach interface failed, port_id=23b984e7-f18d-4c93-9720-0184ff3d6e0a, reason: Instance 093deaa6-a68c-4688-9055-69dda63b6b4c could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:18:30 user nova-compute[75293]: INFO nova.compute.manager [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Took 0.86 seconds to detach 1 volumes for instance.
Nov 30 07:18:30 user nova-compute[75293]: DEBUG nova.compute.manager [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] [instance: 093deaa6-a68c-4688-9055-69dda63b6b4c] Deleting volume: 92ccb270-8b75-445c-b80f-4af3ec1018db {{(pid=75293) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 07:18:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:31 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:18:31 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:18:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.675s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:31 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Deleted allocations for instance 093deaa6-a68c-4688-9055-69dda63b6b4c
Nov 30 07:18:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e1f3c7c1-7a04-4bd4-8870-49b644cf3247 tempest-ServerActionsV293TestJSON-766996460 tempest-ServerActionsV293TestJSON-766996460-project-member] Lock "093deaa6-a68c-4688-9055-69dda63b6b4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.263s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:35 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9295d423-d71c-436b-9306-e0b386a0011f is timed out.
Nov 30 07:18:35 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Successfully detached device vdb from instance 9295d423-d71c-436b-9306-e0b386a0011f from the live domain config.
Nov 30 07:18:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLiXFvwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:18:35 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:18:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[266eba6b-b25b-4137-b49e-fbf437a0203c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:18:35 user nova-compute[75293]: No targets found.
Nov 30 07:18:35 user nova-compute[75293]: iSNS:
Nov 30 07:18:35 user nova-compute[75293]: No targets found.
Nov 30 07:18:35 user nova-compute[75293]: STATIC:
Nov 30 07:18:35 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0
Nov 30 07:18:35 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:18:35 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:18:35 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c
Nov 30 07:18:35 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:18:35 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:18:35 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238
Nov 30 07:18:35 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:18:35 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:18:35 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314
Nov 30 07:18:35 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:18:35 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:18:35 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:18:35 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:18:35 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:18:35 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7
Nov 30 07:18:35 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:18:35 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:18:35 user nova-compute[75293]: FIRMWARE:
Nov 30 07:18:35 user nova-compute[75293]: No targets found.
Nov 30 07:18:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:18:35 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:18:35 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f095cb-22db-4c11-b8a7-4edebd90a8d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b7a9d0-b2a9-4800-af8e-39f334e7754a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:18:35 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:18:35 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:18:35 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:18:35 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:18:35 user nova-compute[75293]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 (non-flash)
Nov 30 07:18:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:18:35 user nova-compute[75293]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c (non-flash)
Nov 30 07:18:35 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:18:35 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:18:35 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:18:35 user nova-compute[75293]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 (non-flash)
Nov 30 07:18:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe8258430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c'): ({'sdb'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Removing single pathed devices sdb {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e694248-b6c6-4d0a-a6f3-edbdc94488d5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbdc3de-6559-4da6-8aa6-7256e0f72811]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Flushing IO for device /dev/sdb {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2feb495e-d5d6-4046-aa27-791458d9fb89]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:18:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f19a46e-2051-436d-83da-c02b7d154058]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf904f5c-bbd5-44fc-ba62-42a6a2c3dfa2]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a70a62e-9a45-4eb2-9026-5d302e89be83]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c, portal: 172.16.0.220,3260]
Nov 30 07:18:36 user nova-compute[75293]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c, portal: 172.16.0.220,3260] successful.
Nov 30 07:18:36 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9d31834-8af6-4f2b-b597-74b774d2e19c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d4b67d-2984-4440-9fa8-82e58f90ec1d]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] <== disconnect_volume: return (359ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:18:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:37 user nova-compute[75293]: DEBUG nova.objects.instance [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lazy-loading 'flavor' on Instance uuid 9295d423-d71c-436b-9306-e0b386a0011f {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:18:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-111a6146-fea4-4bda-b802-c3b90043d812 tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "9295d423-d71c-436b-9306-e0b386a0011f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.508s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "d15108df-facd-4384-8605-ab63534185da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "d15108df-facd-4384-8605-ab63534185da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:40 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:18:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:40 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:18:40 user nova-compute[75293]: INFO nova.compute.claims [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Claim successful on node user
Nov 30 07:18:41 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:18:41 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:18:41 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG nova.policy [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '917adc7b254e4711ad5f5adbdd2689d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d94d0308eb444dbdcd3e5c7c21fe79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:41 user nova-compute[75293]: INFO nova.virt.block_device [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Booting with volume 96494bbf-86fd-4516-8790-e95f0cdba990 at /dev/vda
Nov 30 07:18:41 user nova-compute[75293]: DEBUG os_brick.utils [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69e480d-c710-4e99-be9e-c5b534fd8749]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aadb1d-8b9a-4012-855a-60be2bfaa562]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.041s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ccfa3c-e214-4f05-9071-ce6af89e382e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc54264d-555c-4baa-975d-046cb74cdf97]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:18:41 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:18:41 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6a585b-6a07-42eb-b684-9128ad3a5212]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG os_brick.utils [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Updating existing volume attachment record: ca29e550-df04-41fb-8b08-5d8642d35206 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:18:41 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Successfully created port: f29633df-614b-4b2d-a04a-12398b8c6679 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:18:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:42 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Successfully updated port: f29633df-614b-4b2d-a04a-12398b8c6679 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:18:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "refresh_cache-d15108df-facd-4384-8605-ab63534185da" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:18:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquired lock "refresh_cache-d15108df-facd-4384-8605-ab63534185da" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:18:42 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:18:42 user nova-compute[75293]: DEBUG nova.compute.manager [req-72f97649-91d0-4491-ad2c-5a438e1bccf8 req-e09d5d84-ff77-45f2-a61f-07904c90f092 service nova] [instance: d15108df-facd-4384-8605-ab63534185da] Received event network-changed-f29633df-614b-4b2d-a04a-12398b8c6679 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:18:42 user nova-compute[75293]: DEBUG nova.compute.manager [req-72f97649-91d0-4491-ad2c-5a438e1bccf8 req-e09d5d84-ff77-45f2-a61f-07904c90f092 service nova] [instance: d15108df-facd-4384-8605-ab63534185da] Refreshing instance network info cache due to event network-changed-f29633df-614b-4b2d-a04a-12398b8c6679. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:18:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-72f97649-91d0-4491-ad2c-5a438e1bccf8 req-e09d5d84-ff77-45f2-a61f-07904c90f092 service nova] Acquiring lock "refresh_cache-d15108df-facd-4384-8605-ab63534185da" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:18:42 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:18:43 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Updating instance_info_cache with network_info: [{"id": "f29633df-614b-4b2d-a04a-12398b8c6679", "address": "fa:16:3e:99:0a:e4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29633df-61", "ovs_interfaceid": "f29633df-614b-4b2d-a04a-12398b8c6679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:18:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Releasing lock "refresh_cache-d15108df-facd-4384-8605-ab63534185da" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:18:43 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Instance network_info: |[{"id": "f29633df-614b-4b2d-a04a-12398b8c6679", "address": "fa:16:3e:99:0a:e4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29633df-61", "ovs_interfaceid": "f29633df-614b-4b2d-a04a-12398b8c6679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:18:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-72f97649-91d0-4491-ad2c-5a438e1bccf8 req-e09d5d84-ff77-45f2-a61f-07904c90f092 service nova] Acquired lock "refresh_cache-d15108df-facd-4384-8605-ab63534185da" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:18:43 user nova-compute[75293]: DEBUG nova.network.neutron [req-72f97649-91d0-4491-ad2c-5a438e1bccf8 req-e09d5d84-ff77-45f2-a61f-07904c90f092 service nova] [instance: d15108df-facd-4384-8605-ab63534185da] Refreshing network info cache for port f29633df-614b-4b2d-a04a-12398b8c6679 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:18:43 user nova-compute[75293]: DEBUG nova.network.neutron [req-72f97649-91d0-4491-ad2c-5a438e1bccf8 req-e09d5d84-ff77-45f2-a61f-07904c90f092 service nova] [instance: d15108df-facd-4384-8605-ab63534185da] Updated VIF entry in instance network info cache for port f29633df-614b-4b2d-a04a-12398b8c6679. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:18:43 user nova-compute[75293]: DEBUG nova.network.neutron [req-72f97649-91d0-4491-ad2c-5a438e1bccf8 req-e09d5d84-ff77-45f2-a61f-07904c90f092 service nova] [instance: d15108df-facd-4384-8605-ab63534185da] Updating instance_info_cache with network_info: [{"id": "f29633df-614b-4b2d-a04a-12398b8c6679", "address": "fa:16:3e:99:0a:e4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29633df-61", "ovs_interfaceid": "f29633df-614b-4b2d-a04a-12398b8c6679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:18:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-72f97649-91d0-4491-ad2c-5a438e1bccf8 req-e09d5d84-ff77-45f2-a61f-07904c90f092 service nova] Releasing lock "refresh_cache-d15108df-facd-4384-8605-ab63534185da" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:18:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:48 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a46f0c4f-4449-47e2-aa1e-a4508c81d768 is timed out.
Nov 30 07:18:48 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Successfully detached device vdc from instance a46f0c4f-4449-47e2-aa1e-a4508c81d768 from the live domain config.
Nov 30 07:18:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VLHoyKsT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:18:48 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[288dc3c6-b8e8-4010-bd22-19eb9a6fa15e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:18:48 user nova-compute[75293]: No targets found.
Nov 30 07:18:48 user nova-compute[75293]: iSNS:
Nov 30 07:18:48 user nova-compute[75293]: No targets found.
Nov 30 07:18:48 user nova-compute[75293]: STATIC:
Nov 30 07:18:48 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0
Nov 30 07:18:48 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:18:48 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:18:48 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238
Nov 30 07:18:48 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:18:48 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:18:48 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314
Nov 30 07:18:48 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:18:48 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:18:48 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:18:48 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:18:48 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:18:48 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7
Nov 30 07:18:48 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:18:48 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:18:48 user nova-compute[75293]: FIRMWARE:
Nov 30 07:18:48 user nova-compute[75293]: No targets found.
Nov 30 07:18:48 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:18:48 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:18:48 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53aec1f-0cfc-48de-bbf0-ebcc3466937b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f702e9e1-8c86-46d1-bd24-8f2f81d4a335]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:18:48 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:18:48 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:18:48 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:18:48 user nova-compute[75293]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 (non-flash)
Nov 30 07:18:48 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:18:48 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:18:48 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:18:48 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:18:48 user nova-compute[75293]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 (non-flash)
Nov 30 07:18:48 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe825b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7'): ({'sdi'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Removing single pathed devices sdi {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f52b99-529c-4240-98a8-1cce3db8615f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.031s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88d7479-6bb6-4ecf-8012-d21d0e44a832]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Flushing IO for device /dev/sdi {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bc07a7-4874-4ce1-be4b-22494099707b]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.047s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef53aaf1-a5bf-46c2-9ad4-857fa595a5e8]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] SCSI volumes sdi have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff05a47-6fb3-4dbd-ae4f-c10eb6e54b02]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc0a255-4f9e-4c13-a8b1-e93cf17f9527]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7, portal: 172.16.0.220,3260]
Nov 30 07:18:48 user nova-compute[75293]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7, portal: 172.16.0.220,3260] successful.
Nov 30 07:18:48 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc31cf3-37e3-47fd-aecc-2e35b815efc7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a645466-61d3-41fd-a5be-cd1516d5e76e]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] <== disconnect_volume: return (345ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:18:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:49 user nova-compute[75293]: DEBUG nova.objects.instance [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lazy-loading 'flavor' on Instance uuid a46f0c4f-4449-47e2-aa1e-a4508c81d768 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:18:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3b629320-ce77-4413-aadb-0b3a204dffc0 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.945s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.volume.cinder [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Update attachment failed for attachment ca29e550-df04-41fb-8b08-5d8642d35206. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-94d75810-29b5-49a4-a7bf-efeabc42ac87) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-94d75810-29b5-49a4-a7bf-efeabc42ac87)
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-94d75810-29b5-49a4-a7bf-efeabc42ac87)
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da] Traceback (most recent call last):
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]     driver_block_device.attach_block_devices(
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]     _log_and_attach(device)
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]     bdm.attach(*attach_args, **attach_kwargs)
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]     ret_val = method(obj, context, *args, **kwargs)
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]     self._do_attach(context, instance, volume, volume_api,
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]     self._volume_attach(context, volume, connector, instance,
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]     connection_info = volume_api.attachment_update(
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]     res = method(self, ctx, *args, **kwargs)
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]     with excutils.save_and_reraise_exception():
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]     self.force_reraise()
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]     raise self.value
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]     context, '3.44', skip_version_check=True).attachments.update(
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]     return method.func(obj, *args, **kwargs)
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]     resp = self._update('/attachments/%s' % id, body)
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]     return self._cs_request(url, 'PUT', **kwargs)
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]     return self.request(url, method, **kwargs)
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da]     raise exceptions.from_response(resp, body)
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-94d75810-29b5-49a4-a7bf-efeabc42ac87)
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [instance: d15108df-facd-4384-8605-ab63534185da] 
Nov 30 07:18:50 user nova-compute[75293]: DEBUG nova.compute.claims [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Aborting claim: <nova.compute.claims.Claim object at 0x7effe86ad2d0> {{(pid=75293) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 30 07:18:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:50 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:18:50 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:18:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.485s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:50 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Build of instance d15108df-facd-4384-8605-ab63534185da aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-94d75810-29b5-49a4-a7bf-efeabc42ac87) {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 30 07:18:50 user nova-compute[75293]: DEBUG nova.compute.utils [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Build of instance d15108df-facd-4384-8605-ab63534185da aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75293) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 30 07:18:50 user nova-compute[75293]: ERROR nova.compute.manager [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Build of instance d15108df-facd-4384-8605-ab63534185da aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-94d75810-29b5-49a4-a7bf-efeabc42ac87): nova.exception.BuildAbortException: Build of instance d15108df-facd-4384-8605-ab63534185da aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-94d75810-29b5-49a4-a7bf-efeabc42ac87)
Nov 30 07:18:50 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Unplugging VIFs for instance {{(pid=75293) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 30 07:18:50 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1108268235',display_name='tempest-ServerActionsTestOtherA-server-1108268235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1108268235',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInXIkcLXsgicVrKBV1FJ4eUk9bqleLqUW+Rfq2hagWXh0lWDRkNj3X54YFexKmG2fABDJgaloeZ046QUW/gM3BPiB1qacS7UzihRugfjl4tEjpyq1iC1dsqauDTmCgB5Q==',key_name='tempest-keypair-417038146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7d94d0308eb444dbdcd3e5c7c21fe79',ramdisk_id='',reservation_id='r-95rbfja4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1263829597',owner_user_name='tempest-ServerActionsTestOtherA-1263829597-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:18:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='917adc7b254e4711ad5f5adbdd2689d4',uuid=d15108df-facd-4384-8605-ab63534185da,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f29633df-614b-4b2d-a04a-12398b8c6679", "address": "fa:16:3e:99:0a:e4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29633df-61", "ovs_interfaceid": "f29633df-614b-4b2d-a04a-12398b8c6679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:18:50 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converting VIF {"id": "f29633df-614b-4b2d-a04a-12398b8c6679", "address": "fa:16:3e:99:0a:e4", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29633df-61", "ovs_interfaceid": "f29633df-614b-4b2d-a04a-12398b8c6679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:18:50 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:0a:e4,bridge_name='br-int',has_traffic_filtering=True,id=f29633df-614b-4b2d-a04a-12398b8c6679,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf29633df-61') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:18:50 user nova-compute[75293]: DEBUG os_vif [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:0a:e4,bridge_name='br-int',has_traffic_filtering=True,id=f29633df-614b-4b2d-a04a-12398b8c6679,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf29633df-61') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:18:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf29633df-61, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:18:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:18:50 user nova-compute[75293]: INFO os_vif [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:0a:e4,bridge_name='br-int',has_traffic_filtering=True,id=f29633df-614b-4b2d-a04a-12398b8c6679,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf29633df-61')
Nov 30 07:18:50 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Unplugged VIFs for instance {{(pid=75293) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 30 07:18:50 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:18:50 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:18:50 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:18:51 user nova-compute[75293]: INFO nova.compute.manager [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Took 0.46 seconds to deallocate network for instance.
Nov 30 07:18:51 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Detaching volume: 96494bbf-86fd-4516-8790-e95f0cdba990 {{(pid=75293) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 30 07:18:51 user nova-compute[75293]: INFO nova.compute.manager [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Detaching volume 96494bbf-86fd-4516-8790-e95f0cdba990
Nov 30 07:18:51 user nova-compute[75293]: ERROR nova.virt.block_device [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Unable to call for a driver detach of volume 96494bbf-86fd-4516-8790-e95f0cdba990 due to the instance being registered to the remote host None.: nova.exception.BuildAbortException: Build of instance d15108df-facd-4384-8605-ab63534185da aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-94d75810-29b5-49a4-a7bf-efeabc42ac87)
Nov 30 07:18:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:51 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: d15108df-facd-4384-8605-ab63534185da] Deleting volume: 96494bbf-86fd-4516-8790-e95f0cdba990 {{(pid=75293) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 07:18:51 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Deleted allocations for instance d15108df-facd-4384-8605-ab63534185da
Nov 30 07:18:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f6804dee-2d54-4992-a814-2be5f5741270 tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "d15108df-facd-4384-8605-ab63534185da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.099s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:51 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:18:53 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:18:53 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:18:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-c8d1df78-2aa2-4710-a570-5f72c60cfc26" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:18:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-c8d1df78-2aa2-4710-a570-5f72c60cfc26" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:18:53 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:18:54 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Updating instance_info_cache with network_info: [{"id": "66299713-0237-47db-9fef-e5816beed9d9", "address": "fa:16:3e:db:c2:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66299713-02", "ovs_interfaceid": "66299713-0237-47db-9fef-e5816beed9d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:18:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-c8d1df78-2aa2-4710-a570-5f72c60cfc26" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:18:54 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:18:54 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:18:54 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:18:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:54 user nova-compute[75293]: DEBUG nova.compute.manager [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:18:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:18:54 user nova-compute[75293]: INFO nova.compute.claims [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Claim successful on node user
Nov 30 07:18:54 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG nova.compute.manager [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG nova.compute.manager [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG nova.network.neutron [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:18:55 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:18:55 user nova-compute[75293]: DEBUG nova.compute.manager [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG nova.policy [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '413f65d184084af4be1418367fd3b9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9623b2e7295481597a1c6e925ed5d06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG nova.compute.manager [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:18:55 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Creating image(s)
Nov 30 07:18:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "/opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "/opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.187s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.195s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk 1073741824" returned: 0 in 0.058s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG nova.network.neutron [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Successfully created port: ea487809-e5c3-435b-be3e-f59400b4d9cd {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.194s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Cannot resize image /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Ensure instance console log exists: /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG nova.network.neutron [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Successfully updated port: ea487809-e5c3-435b-be3e-f59400b4d9cd {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "refresh_cache-4ebf0be9-15e0-418c-a554-7885c79a725b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquired lock "refresh_cache-4ebf0be9-15e0-418c-a554-7885c79a725b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG nova.network.neutron [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG nova.compute.manager [req-3544f60a-c2b6-44b4-95c5-92bfe18f7427 req-ee7a3bc2-43d6-452f-ae42-8b3e40a48526 service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Received event network-changed-ea487809-e5c3-435b-be3e-f59400b4d9cd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG nova.compute.manager [req-3544f60a-c2b6-44b4-95c5-92bfe18f7427 req-ee7a3bc2-43d6-452f-ae42-8b3e40a48526 service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Refreshing instance network info cache due to event network-changed-ea487809-e5c3-435b-be3e-f59400b4d9cd. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3544f60a-c2b6-44b4-95c5-92bfe18f7427 req-ee7a3bc2-43d6-452f-ae42-8b3e40a48526 service nova] Acquiring lock "refresh_cache-4ebf0be9-15e0-418c-a554-7885c79a725b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG nova.network.neutron [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:18:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.network.neutron [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Updating instance_info_cache with network_info: [{"id": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "address": "fa:16:3e:61:ea:d9", "network": {"id": "f5788c0d-7b19-4bf5-8197-f7a852630bd6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1462636557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9623b2e7295481597a1c6e925ed5d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea487809-e5", "ovs_interfaceid": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Releasing lock "refresh_cache-4ebf0be9-15e0-418c-a554-7885c79a725b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.compute.manager [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Instance network_info: |[{"id": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "address": "fa:16:3e:61:ea:d9", "network": {"id": "f5788c0d-7b19-4bf5-8197-f7a852630bd6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1462636557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9623b2e7295481597a1c6e925ed5d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea487809-e5", "ovs_interfaceid": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3544f60a-c2b6-44b4-95c5-92bfe18f7427 req-ee7a3bc2-43d6-452f-ae42-8b3e40a48526 service nova] Acquired lock "refresh_cache-4ebf0be9-15e0-418c-a554-7885c79a725b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.network.neutron [req-3544f60a-c2b6-44b4-95c5-92bfe18f7427 req-ee7a3bc2-43d6-452f-ae42-8b3e40a48526 service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Refreshing network info cache for port ea487809-e5c3-435b-be3e-f59400b4d9cd {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Start _get_guest_xml network_info=[{"id": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "address": "fa:16:3e:61:ea:d9", "network": {"id": "f5788c0d-7b19-4bf5-8197-f7a852630bd6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1462636557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9623b2e7295481597a1c6e925ed5d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea487809-e5", "ovs_interfaceid": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:18:57 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:18:57 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1604218845',display_name='tempest-SnapshotDataIntegrityTests-server-1604218845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1604218845',id=32,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzYsxZ418k2vj1YYw6cdBYwMBQ4dcEd5pIhCIZp6CbUzAItFtfho7tBwYOSXNU/KeqidVSjxlNTuuaLnfDZOLOPRS986mNk82h+lfxvXWq+0zijBaykK6Y6fhpT7KooDg==',key_name='tempest-keypair-775752113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9623b2e7295481597a1c6e925ed5d06',ramdisk_id='',reservation_id='r-s2i3etsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-263033880',owner_user_name='tempest-SnapshotDataIntegrityTests-263033880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413f65d184084af4be1418367fd3b9da',uuid=4ebf0be9-15e0-418c-a554-7885c79a725b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "address": "fa:16:3e:61:ea:d9", "network": {"id": "f5788c0d-7b19-4bf5-8197-f7a852630bd6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1462636557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9623b2e7295481597a1c6e925ed5d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea487809-e5", "ovs_interfaceid": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Converting VIF {"id": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "address": "fa:16:3e:61:ea:d9", "network": {"id": "f5788c0d-7b19-4bf5-8197-f7a852630bd6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1462636557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9623b2e7295481597a1c6e925ed5d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea487809-e5", "ovs_interfaceid": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ea:d9,bridge_name='br-int',has_traffic_filtering=True,id=ea487809-e5c3-435b-be3e-f59400b4d9cd,network=Network(f5788c0d-7b19-4bf5-8197-f7a852630bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea487809-e5') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.objects.instance [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ebf0be9-15e0-418c-a554-7885c79a725b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:18:57 user nova-compute[75293]:   <uuid>4ebf0be9-15e0-418c-a554-7885c79a725b</uuid>
Nov 30 07:18:57 user nova-compute[75293]:   <name>instance-00000020</name>
Nov 30 07:18:57 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:18:57 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:18:57 user nova-compute[75293]:   <metadata>
Nov 30 07:18:57 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:18:57 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:18:57 user nova-compute[75293]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1604218845</nova:name>
Nov 30 07:18:57 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:18:57</nova:creationTime>
Nov 30 07:18:57 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:18:57 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:18:57 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:18:57 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:18:57 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:18:57 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:18:57 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:18:57 user nova-compute[75293]:       <nova:owner>
Nov 30 07:18:57 user nova-compute[75293]:         <nova:user uuid="413f65d184084af4be1418367fd3b9da">tempest-SnapshotDataIntegrityTests-263033880-project-member</nova:user>
Nov 30 07:18:57 user nova-compute[75293]:         <nova:project uuid="f9623b2e7295481597a1c6e925ed5d06">tempest-SnapshotDataIntegrityTests-263033880</nova:project>
Nov 30 07:18:57 user nova-compute[75293]:       </nova:owner>
Nov 30 07:18:57 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:18:57 user nova-compute[75293]:       <nova:ports>
Nov 30 07:18:57 user nova-compute[75293]:         <nova:port uuid="ea487809-e5c3-435b-be3e-f59400b4d9cd">
Nov 30 07:18:57 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 07:18:57 user nova-compute[75293]:         </nova:port>
Nov 30 07:18:57 user nova-compute[75293]:       </nova:ports>
Nov 30 07:18:57 user nova-compute[75293]:     </nova:instance>
Nov 30 07:18:57 user nova-compute[75293]:   </metadata>
Nov 30 07:18:57 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:18:57 user nova-compute[75293]:     <system>
Nov 30 07:18:57 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:18:57 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:18:57 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:18:57 user nova-compute[75293]:       <entry name="serial">4ebf0be9-15e0-418c-a554-7885c79a725b</entry>
Nov 30 07:18:57 user nova-compute[75293]:       <entry name="uuid">4ebf0be9-15e0-418c-a554-7885c79a725b</entry>
Nov 30 07:18:57 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:18:57 user nova-compute[75293]:     </system>
Nov 30 07:18:57 user nova-compute[75293]:   </sysinfo>
Nov 30 07:18:57 user nova-compute[75293]:   <os>
Nov 30 07:18:57 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:18:57 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:18:57 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:18:57 user nova-compute[75293]:   </os>
Nov 30 07:18:57 user nova-compute[75293]:   <features>
Nov 30 07:18:57 user nova-compute[75293]:     <acpi/>
Nov 30 07:18:57 user nova-compute[75293]:     <apic/>
Nov 30 07:18:57 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:18:57 user nova-compute[75293]:   </features>
Nov 30 07:18:57 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:18:57 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:18:57 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:18:57 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:18:57 user nova-compute[75293]:   </clock>
Nov 30 07:18:57 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:18:57 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:18:57 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:18:57 user nova-compute[75293]:   </cpu>
Nov 30 07:18:57 user nova-compute[75293]:   <devices>
Nov 30 07:18:57 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:18:57 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:18:57 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk"/>
Nov 30 07:18:57 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:18:57 user nova-compute[75293]:     </disk>
Nov 30 07:18:57 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:18:57 user nova-compute[75293]:       <mac address="fa:16:3e:61:ea:d9"/>
Nov 30 07:18:57 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:18:57 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:18:57 user nova-compute[75293]:       <target dev="tapea487809-e5"/>
Nov 30 07:18:57 user nova-compute[75293]:     </interface>
Nov 30 07:18:57 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:18:57 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/console.log" append="off"/>
Nov 30 07:18:57 user nova-compute[75293]:     </serial>
Nov 30 07:18:57 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:18:57 user nova-compute[75293]:     <video>
Nov 30 07:18:57 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:18:57 user nova-compute[75293]:     </video>
Nov 30 07:18:57 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:18:57 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:18:57 user nova-compute[75293]:     </rng>
Nov 30 07:18:57 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:18:57 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:18:57 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:18:57 user nova-compute[75293]:     </memballoon>
Nov 30 07:18:57 user nova-compute[75293]:   </devices>
Nov 30 07:18:57 user nova-compute[75293]: </domain>
Nov 30 07:18:57 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1604218845',display_name='tempest-SnapshotDataIntegrityTests-server-1604218845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1604218845',id=32,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzYsxZ418k2vj1YYw6cdBYwMBQ4dcEd5pIhCIZp6CbUzAItFtfho7tBwYOSXNU/KeqidVSjxlNTuuaLnfDZOLOPRS986mNk82h+lfxvXWq+0zijBaykK6Y6fhpT7KooDg==',key_name='tempest-keypair-775752113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9623b2e7295481597a1c6e925ed5d06',ramdisk_id='',reservation_id='r-s2i3etsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-263033880',owner_user_name='tempest-SnapshotDataIntegrityTests-263033880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413f65d184084af4be1418367fd3b9da',uuid=4ebf0be9-15e0-418c-a554-7885c79a725b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "address": "fa:16:3e:61:ea:d9", "network": {"id": "f5788c0d-7b19-4bf5-8197-f7a852630bd6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1462636557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9623b2e7295481597a1c6e925ed5d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea487809-e5", "ovs_interfaceid": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Converting VIF {"id": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "address": "fa:16:3e:61:ea:d9", "network": {"id": "f5788c0d-7b19-4bf5-8197-f7a852630bd6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1462636557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9623b2e7295481597a1c6e925ed5d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea487809-e5", "ovs_interfaceid": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ea:d9,bridge_name='br-int',has_traffic_filtering=True,id=ea487809-e5c3-435b-be3e-f59400b4d9cd,network=Network(f5788c0d-7b19-4bf5-8197-f7a852630bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea487809-e5') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG os_vif [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ea:d9,bridge_name='br-int',has_traffic_filtering=True,id=ea487809-e5c3-435b-be3e-f59400b4d9cd,network=Network(f5788c0d-7b19-4bf5-8197-f7a852630bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea487809-e5') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fe65f2e-29a8-5a47-a30a-33a2b5ce8677', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea487809-e5, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea487809-e5, col_values=(('qos', UUID('c3c416ae-33fc-43d7-adb3-82ec7fbd950a')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea487809-e5, col_values=(('external_ids', {'iface-id': 'ea487809-e5c3-435b-be3e-f59400b4d9cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:ea:d9', 'vm-uuid': '4ebf0be9-15e0-418c-a554-7885c79a725b'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:57 user nova-compute[75293]: INFO os_vif [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ea:d9,bridge_name='br-int',has_traffic_filtering=True,id=ea487809-e5c3-435b-be3e-f59400b4d9cd,network=Network(f5788c0d-7b19-4bf5-8197-f7a852630bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea487809-e5')
Nov 30 07:18:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] No VIF found with MAC fa:16:3e:61:ea:d9, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.network.neutron [req-3544f60a-c2b6-44b4-95c5-92bfe18f7427 req-ee7a3bc2-43d6-452f-ae42-8b3e40a48526 service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Updated VIF entry in instance network info cache for port ea487809-e5c3-435b-be3e-f59400b4d9cd. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.network.neutron [req-3544f60a-c2b6-44b4-95c5-92bfe18f7427 req-ee7a3bc2-43d6-452f-ae42-8b3e40a48526 service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Updating instance_info_cache with network_info: [{"id": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "address": "fa:16:3e:61:ea:d9", "network": {"id": "f5788c0d-7b19-4bf5-8197-f7a852630bd6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1462636557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9623b2e7295481597a1c6e925ed5d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea487809-e5", "ovs_interfaceid": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3544f60a-c2b6-44b4-95c5-92bfe18f7427 req-ee7a3bc2-43d6-452f-ae42-8b3e40a48526 service nova] Releasing lock "refresh_cache-4ebf0be9-15e0-418c-a554-7885c79a725b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:58 user nova-compute[75293]: DEBUG nova.compute.manager [req-4fc3c450-f9c9-4e23-86b9-4474f7b11536 req-86a54efb-a126-4d4f-9633-f183486fb865 service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Received event network-vif-plugged-ea487809-e5c3-435b-be3e-f59400b4d9cd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:18:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4fc3c450-f9c9-4e23-86b9-4474f7b11536 req-86a54efb-a126-4d4f-9633-f183486fb865 service nova] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:18:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4fc3c450-f9c9-4e23-86b9-4474f7b11536 req-86a54efb-a126-4d4f-9633-f183486fb865 service nova] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:18:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4fc3c450-f9c9-4e23-86b9-4474f7b11536 req-86a54efb-a126-4d4f-9633-f183486fb865 service nova] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:18:58 user nova-compute[75293]: DEBUG nova.compute.manager [req-4fc3c450-f9c9-4e23-86b9-4474f7b11536 req-86a54efb-a126-4d4f-9633-f183486fb865 service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] No waiting events found dispatching network-vif-plugged-ea487809-e5c3-435b-be3e-f59400b4d9cd {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:18:58 user nova-compute[75293]: WARNING nova.compute.manager [req-4fc3c450-f9c9-4e23-86b9-4474f7b11536 req-86a54efb-a126-4d4f-9633-f183486fb865 service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Received unexpected event network-vif-plugged-ea487809-e5c3-435b-be3e-f59400b4d9cd for instance with vm_state building and task_state spawning.
Nov 30 07:18:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:18:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b9424a3-3053-4b8f-9eb9-5c81944a8fd5/disk.rescue --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:18:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b9424a3-3053-4b8f-9eb9-5c81944a8fd5/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b9424a3-3053-4b8f-9eb9-5c81944a8fd5/disk.rescue --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b9424a3-3053-4b8f-9eb9-5c81944a8fd5/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:18:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:18:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:19:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.manager [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.manager [req-c72be347-9d38-44c5-8b74-6bc9af9901f7 req-93921d72-ac06-4310-8cd4-09f2fd651a1a service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Received event network-vif-plugged-ea487809-e5c3-435b-be3e-f59400b4d9cd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c72be347-9d38-44c5-8b74-6bc9af9901f7 req-93921d72-ac06-4310-8cd4-09f2fd651a1a service nova] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c72be347-9d38-44c5-8b74-6bc9af9901f7 req-93921d72-ac06-4310-8cd4-09f2fd651a1a service nova] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c72be347-9d38-44c5-8b74-6bc9af9901f7 req-93921d72-ac06-4310-8cd4-09f2fd651a1a service nova] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.manager [req-c72be347-9d38-44c5-8b74-6bc9af9901f7 req-93921d72-ac06-4310-8cd4-09f2fd651a1a service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] No waiting events found dispatching network-vif-plugged-ea487809-e5c3-435b-be3e-f59400b4d9cd {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:19:01 user nova-compute[75293]: WARNING nova.compute.manager [req-c72be347-9d38-44c5-8b74-6bc9af9901f7 req-93921d72-ac06-4310-8cd4-09f2fd651a1a service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Received unexpected event network-vif-plugged-ea487809-e5c3-435b-be3e-f59400b4d9cd for instance with vm_state building and task_state spawning.
Nov 30 07:19:01 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:19:01 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=6918MB free_disk=24.826004028320312GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:01 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Instance spawned successfully.
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:19:01 user nova-compute[75293]: INFO nova.compute.manager [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.manager [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b7deb0a-39af-4d93-b93d-5765a731f702 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance c8d1df78-2aa2-4710-a570-5f72c60cfc26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9295d423-d71c-436b-9306-e0b386a0011f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance d34f99fc-343e-4e8a-83e6-372b0326bded actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 4be43bb1-b17c-40b9-953a-c820f2396176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance ed037c80-4f33-4e03-907c-18b4ea122411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance a46f0c4f-4449-47e2-aa1e-a4508c81d768 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 821af6a7-0ab8-4947-afaf-e97b2b781375 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance f5162965-1cf1-4f92-86fc-88c1004748c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 677602ec-88fd-4026-8112-8469855f8a78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 39042069-ac9b-4b13-b486-c845e84ac041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 4ebf0be9-15e0-418c-a554-7885c79a725b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:19:01 user nova-compute[75293]: INFO nova.compute.manager [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Took 6.59 seconds to build instance.
Nov 30 07:19:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-466c8b0e-c109-47fc-ac10-0682933b1e00 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.686s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:19:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.612s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:02 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:19:02 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:19:02 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:19:02 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:19:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquiring lock "821af6a7-0ab8-4947-afaf-e97b2b781375" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "821af6a7-0ab8-4947-afaf-e97b2b781375" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquiring lock "821af6a7-0ab8-4947-afaf-e97b2b781375-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "821af6a7-0ab8-4947-afaf-e97b2b781375-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "821af6a7-0ab8-4947-afaf-e97b2b781375-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:06 user nova-compute[75293]: INFO nova.compute.manager [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Terminating instance
Nov 30 07:19:06 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:19:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-44b1af08-da06-4a89-bfe6-d42fd4e4496f req-3486f41f-50e7-46ed-9768-18da3059a835 service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Received event network-vif-unplugged-cc58bfc6-9bcd-41e7-aa0c-b14c293440e3 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-44b1af08-da06-4a89-bfe6-d42fd4e4496f req-3486f41f-50e7-46ed-9768-18da3059a835 service nova] Acquiring lock "821af6a7-0ab8-4947-afaf-e97b2b781375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-44b1af08-da06-4a89-bfe6-d42fd4e4496f req-3486f41f-50e7-46ed-9768-18da3059a835 service nova] Lock "821af6a7-0ab8-4947-afaf-e97b2b781375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-44b1af08-da06-4a89-bfe6-d42fd4e4496f req-3486f41f-50e7-46ed-9768-18da3059a835 service nova] Lock "821af6a7-0ab8-4947-afaf-e97b2b781375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-44b1af08-da06-4a89-bfe6-d42fd4e4496f req-3486f41f-50e7-46ed-9768-18da3059a835 service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] No waiting events found dispatching network-vif-unplugged-cc58bfc6-9bcd-41e7-aa0c-b14c293440e3 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:19:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-44b1af08-da06-4a89-bfe6-d42fd4e4496f req-3486f41f-50e7-46ed-9768-18da3059a835 service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Received event network-vif-unplugged-cc58bfc6-9bcd-41e7-aa0c-b14c293440e3 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:19:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:07 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Instance destroyed successfully.
Nov 30 07:19:07 user nova-compute[75293]: DEBUG nova.objects.instance [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lazy-loading 'resources' on Instance uuid 821af6a7-0ab8-4947-afaf-e97b2b781375 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:19:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-897528997',display_name='tempest-ServersNegativeTestJSON-server-897528997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-897528997',id=28,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:17:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8744f39a1f6d424fa13d77ed2ced51c5',ramdisk_id='',reservation_id='r-rmcib07y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1767090220',owner_user_name='tempest-ServersNegativeTestJSON-1767090220-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:17:25Z,user_data=None,user_id='f04441af417245e2a68e11d52ad7b05f',uuid=821af6a7-0ab8-4947-afaf-e97b2b781375,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "address": "fa:16:3e:84:bd:f7", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc58bfc6-9b", "ovs_interfaceid": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:19:07 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Converting VIF {"id": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "address": "fa:16:3e:84:bd:f7", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc58bfc6-9b", "ovs_interfaceid": "cc58bfc6-9bcd-41e7-aa0c-b14c293440e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:19:07 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:bd:f7,bridge_name='br-int',has_traffic_filtering=True,id=cc58bfc6-9bcd-41e7-aa0c-b14c293440e3,network=Network(f557522c-aed7-4965-8036-cb4260a19168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc58bfc6-9b') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:19:07 user nova-compute[75293]: DEBUG os_vif [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:bd:f7,bridge_name='br-int',has_traffic_filtering=True,id=cc58bfc6-9bcd-41e7-aa0c-b14c293440e3,network=Network(f557522c-aed7-4965-8036-cb4260a19168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc58bfc6-9b') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:19:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc58bfc6-9b, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:19:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ee9937e-e81b-4339-92b1-c36964eb19bf) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:19:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:07 user nova-compute[75293]: INFO os_vif [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:bd:f7,bridge_name='br-int',has_traffic_filtering=True,id=cc58bfc6-9bcd-41e7-aa0c-b14c293440e3,network=Network(f557522c-aed7-4965-8036-cb4260a19168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc58bfc6-9b')
Nov 30 07:19:07 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Deleting instance files /opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375_del
Nov 30 07:19:07 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Deletion of /opt/stack/data/nova/instances/821af6a7-0ab8-4947-afaf-e97b2b781375_del complete
Nov 30 07:19:07 user nova-compute[75293]: INFO nova.compute.manager [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 30 07:19:07 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:19:07 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:19:07 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:19:07 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:19:07 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Took 0.38 seconds to deallocate network for instance.
Nov 30 07:19:07 user nova-compute[75293]: DEBUG nova.compute.manager [req-415469ae-bba2-4b52-9010-29e82310e55a req-bfe9cde5-e0d4-4b2e-9a18-652602fd3d60 service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Received event network-vif-deleted-cc58bfc6-9bcd-41e7-aa0c-b14c293440e3 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:07 user nova-compute[75293]: INFO nova.compute.manager [req-415469ae-bba2-4b52-9010-29e82310e55a req-bfe9cde5-e0d4-4b2e-9a18-652602fd3d60 service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Neutron deleted interface cc58bfc6-9bcd-41e7-aa0c-b14c293440e3; detaching it from the instance and deleting it from the info cache
Nov 30 07:19:07 user nova-compute[75293]: DEBUG nova.network.neutron [req-415469ae-bba2-4b52-9010-29e82310e55a req-bfe9cde5-e0d4-4b2e-9a18-652602fd3d60 service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:19:07 user nova-compute[75293]: DEBUG nova.compute.manager [req-415469ae-bba2-4b52-9010-29e82310e55a req-bfe9cde5-e0d4-4b2e-9a18-652602fd3d60 service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Detach interface failed, port_id=cc58bfc6-9bcd-41e7-aa0c-b14c293440e3, reason: Instance 821af6a7-0ab8-4947-afaf-e97b2b781375 could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:19:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:07 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:19:08 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:19:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:08 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Deleted allocations for instance 821af6a7-0ab8-4947-afaf-e97b2b781375
Nov 30 07:19:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6b6bb297-054e-48d0-ac71-b1df42005a50 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "821af6a7-0ab8-4947-afaf-e97b2b781375" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.878s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-6056ede6-3299-412c-b9fd-f5f4aa292500 req-90381ab7-9b3c-47f6-8f1a-52fbc9cf7294 service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Received event network-vif-plugged-cc58bfc6-9bcd-41e7-aa0c-b14c293440e3 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6056ede6-3299-412c-b9fd-f5f4aa292500 req-90381ab7-9b3c-47f6-8f1a-52fbc9cf7294 service nova] Acquiring lock "821af6a7-0ab8-4947-afaf-e97b2b781375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6056ede6-3299-412c-b9fd-f5f4aa292500 req-90381ab7-9b3c-47f6-8f1a-52fbc9cf7294 service nova] Lock "821af6a7-0ab8-4947-afaf-e97b2b781375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6056ede6-3299-412c-b9fd-f5f4aa292500 req-90381ab7-9b3c-47f6-8f1a-52fbc9cf7294 service nova] Lock "821af6a7-0ab8-4947-afaf-e97b2b781375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-6056ede6-3299-412c-b9fd-f5f4aa292500 req-90381ab7-9b3c-47f6-8f1a-52fbc9cf7294 service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] No waiting events found dispatching network-vif-plugged-cc58bfc6-9bcd-41e7-aa0c-b14c293440e3 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:19:08 user nova-compute[75293]: WARNING nova.compute.manager [req-6056ede6-3299-412c-b9fd-f5f4aa292500 req-90381ab7-9b3c-47f6-8f1a-52fbc9cf7294 service nova] [instance: 821af6a7-0ab8-4947-afaf-e97b2b781375] Received unexpected event network-vif-plugged-cc58bfc6-9bcd-41e7-aa0c-b14c293440e3 for instance with vm_state deleted and task_state None.
Nov 30 07:19:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "9295d423-d71c-436b-9306-e0b386a0011f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "9295d423-d71c-436b-9306-e0b386a0011f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "9295d423-d71c-436b-9306-e0b386a0011f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "9295d423-d71c-436b-9306-e0b386a0011f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "9295d423-d71c-436b-9306-e0b386a0011f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:09 user nova-compute[75293]: INFO nova.compute.manager [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Terminating instance
Nov 30 07:19:09 user nova-compute[75293]: DEBUG nova.compute.manager [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:19:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:10 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Instance destroyed successfully.
Nov 30 07:19:10 user nova-compute[75293]: DEBUG nova.objects.instance [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lazy-loading 'resources' on Instance uuid 9295d423-d71c-436b-9306-e0b386a0011f {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1812462465',display_name='tempest-TestMinimumBasicScenario-server-1812462465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1812462465',id=18,image_ref='01bc1251-0d5f-4ede-a6bd-abbef2cf058c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGM8RAkZ2JZRI8v4gPf85M8NNY1FgdCrAHhat5E90+q6+Ji/L6jj0KbdjG1v2GzxdNdf3Br+yyDZhSTkfDh9NlrsciRV88oMuE3Vly4qEb1BQZ31txgr8Dfqj2cQH/t03g==',key_name='tempest-TestMinimumBasicScenario-768959219',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:14:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='995a27035c0c4b59b4bc11ef5ed479e7',ramdisk_id='',reservation_id='r-xknvg9uq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01bc1251-0d5f-4ede-a6bd-abbef2cf058c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1736397132',owner_user_name='tempest-TestMinimumBasicScenario-1736397132-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:16:27Z,user_data=None,user_id='6c37e36f7b5c4dfe815886140d24ea26',uuid=9295d423-d71c-436b-9306-e0b386a0011f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "address": "fa:16:3e:93:db:1e", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4367d997-9d", "ovs_interfaceid": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Converting VIF {"id": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "address": "fa:16:3e:93:db:1e", "network": {"id": "03583eec-fca2-4294-97d0-79e4bc1f1d10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2043282446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "995a27035c0c4b59b4bc11ef5ed479e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4367d997-9d", "ovs_interfaceid": "4367d997-9d95-45a9-9a95-ddb8a27595c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:db:1e,bridge_name='br-int',has_traffic_filtering=True,id=4367d997-9d95-45a9-9a95-ddb8a27595c6,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4367d997-9d') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG os_vif [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:db:1e,bridge_name='br-int',has_traffic_filtering=True,id=4367d997-9d95-45a9-9a95-ddb8a27595c6,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4367d997-9d') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4367d997-9d, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2971ee0e-d869-4f2a-ac0b-17600b39e118) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:19:10 user nova-compute[75293]: INFO os_vif [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:db:1e,bridge_name='br-int',has_traffic_filtering=True,id=4367d997-9d95-45a9-9a95-ddb8a27595c6,network=Network(03583eec-fca2-4294-97d0-79e4bc1f1d10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4367d997-9d')
Nov 30 07:19:10 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Deleting instance files /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f_del
Nov 30 07:19:10 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Deletion of /opt/stack/data/nova/instances/9295d423-d71c-436b-9306-e0b386a0011f_del complete
Nov 30 07:19:10 user nova-compute[75293]: INFO nova.compute.manager [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 30 07:19:10 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:19:10 user nova-compute[75293]: INFO nova.compute.manager [None req-a87ea6fa-37c8-463b-9422-f313849cc067 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Unrescuing
Nov 30 07:19:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a87ea6fa-37c8-463b-9422-f313849cc067 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "refresh_cache-9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a87ea6fa-37c8-463b-9422-f313849cc067 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquired lock "refresh_cache-9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG nova.network.neutron [None req-a87ea6fa-37c8-463b-9422-f313849cc067 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG nova.compute.manager [req-aacbbf2a-de92-4f8b-a47f-8f4171c35662 req-24f9e9da-31b1-4bbf-9476-94ab63c9f8ac service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received event network-vif-deleted-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:10 user nova-compute[75293]: INFO nova.compute.manager [req-aacbbf2a-de92-4f8b-a47f-8f4171c35662 req-24f9e9da-31b1-4bbf-9476-94ab63c9f8ac service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Neutron deleted interface 4367d997-9d95-45a9-9a95-ddb8a27595c6; detaching it from the instance and deleting it from the info cache
Nov 30 07:19:10 user nova-compute[75293]: DEBUG nova.network.neutron [req-aacbbf2a-de92-4f8b-a47f-8f4171c35662 req-24f9e9da-31b1-4bbf-9476-94ab63c9f8ac service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:19:10 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Took 0.65 seconds to deallocate network for instance.
Nov 30 07:19:10 user nova-compute[75293]: DEBUG nova.compute.manager [req-aacbbf2a-de92-4f8b-a47f-8f4171c35662 req-24f9e9da-31b1-4bbf-9476-94ab63c9f8ac service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Detach interface failed, port_id=4367d997-9d95-45a9-9a95-ddb8a27595c6, reason: Instance 9295d423-d71c-436b-9306-e0b386a0011f could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG nova.compute.manager [req-d571fc75-06e1-4b5c-98f4-80d86d4a8fec req-48473c2f-7ddd-44f9-9e3f-04bf57be5589 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received event network-vif-unplugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d571fc75-06e1-4b5c-98f4-80d86d4a8fec req-48473c2f-7ddd-44f9-9e3f-04bf57be5589 service nova] Acquiring lock "9295d423-d71c-436b-9306-e0b386a0011f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d571fc75-06e1-4b5c-98f4-80d86d4a8fec req-48473c2f-7ddd-44f9-9e3f-04bf57be5589 service nova] Lock "9295d423-d71c-436b-9306-e0b386a0011f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d571fc75-06e1-4b5c-98f4-80d86d4a8fec req-48473c2f-7ddd-44f9-9e3f-04bf57be5589 service nova] Lock "9295d423-d71c-436b-9306-e0b386a0011f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG nova.compute.manager [req-d571fc75-06e1-4b5c-98f4-80d86d4a8fec req-48473c2f-7ddd-44f9-9e3f-04bf57be5589 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] No waiting events found dispatching network-vif-unplugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:19:10 user nova-compute[75293]: WARNING nova.compute.manager [req-d571fc75-06e1-4b5c-98f4-80d86d4a8fec req-48473c2f-7ddd-44f9-9e3f-04bf57be5589 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received unexpected event network-vif-unplugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 for instance with vm_state deleted and task_state None.
Nov 30 07:19:10 user nova-compute[75293]: DEBUG nova.compute.manager [req-d571fc75-06e1-4b5c-98f4-80d86d4a8fec req-48473c2f-7ddd-44f9-9e3f-04bf57be5589 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received event network-vif-plugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d571fc75-06e1-4b5c-98f4-80d86d4a8fec req-48473c2f-7ddd-44f9-9e3f-04bf57be5589 service nova] Acquiring lock "9295d423-d71c-436b-9306-e0b386a0011f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d571fc75-06e1-4b5c-98f4-80d86d4a8fec req-48473c2f-7ddd-44f9-9e3f-04bf57be5589 service nova] Lock "9295d423-d71c-436b-9306-e0b386a0011f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d571fc75-06e1-4b5c-98f4-80d86d4a8fec req-48473c2f-7ddd-44f9-9e3f-04bf57be5589 service nova] Lock "9295d423-d71c-436b-9306-e0b386a0011f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:10 user nova-compute[75293]: DEBUG nova.compute.manager [req-d571fc75-06e1-4b5c-98f4-80d86d4a8fec req-48473c2f-7ddd-44f9-9e3f-04bf57be5589 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] No waiting events found dispatching network-vif-plugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:19:10 user nova-compute[75293]: WARNING nova.compute.manager [req-d571fc75-06e1-4b5c-98f4-80d86d4a8fec req-48473c2f-7ddd-44f9-9e3f-04bf57be5589 service nova] [instance: 9295d423-d71c-436b-9306-e0b386a0011f] Received unexpected event network-vif-plugged-4367d997-9d95-45a9-9a95-ddb8a27595c6 for instance with vm_state deleted and task_state None.
Nov 30 07:19:11 user nova-compute[75293]: DEBUG nova.network.neutron [None req-a87ea6fa-37c8-463b-9422-f313849cc067 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Updating instance_info_cache with network_info: [{"id": "094f0848-c129-4499-8781-6943982188b6", "address": "fa:16:3e:44:2f:52", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094f0848-c1", "ovs_interfaceid": "094f0848-c129-4499-8781-6943982188b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:19:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a87ea6fa-37c8-463b-9422-f313849cc067 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Releasing lock "refresh_cache-9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:19:11 user nova-compute[75293]: DEBUG nova.objects.instance [None req-a87ea6fa-37c8-463b-9422-f313849cc067 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'flavor' on Instance uuid 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:19:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:11 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:19:11 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:19:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.629s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:11 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Deleted allocations for instance 9295d423-d71c-436b-9306-e0b386a0011f
Nov 30 07:19:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fcd0334b-8689-4887-927a-a8a388bb42de tempest-TestMinimumBasicScenario-1736397132 tempest-TestMinimumBasicScenario-1736397132-project-member] Lock "9295d423-d71c-436b-9306-e0b386a0011f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.371s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:11 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Instance destroyed successfully.
Nov 30 07:19:13 user nova-compute[75293]: DEBUG nova.compute.manager [req-857f76cf-2441-4363-a7ae-1912f02da70f req-b6dfda86-e476-4179-ae7f-f16cbfeb5824 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received event network-vif-unplugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-857f76cf-2441-4363-a7ae-1912f02da70f req-b6dfda86-e476-4179-ae7f-f16cbfeb5824 service nova] Acquiring lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-857f76cf-2441-4363-a7ae-1912f02da70f req-b6dfda86-e476-4179-ae7f-f16cbfeb5824 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-857f76cf-2441-4363-a7ae-1912f02da70f req-b6dfda86-e476-4179-ae7f-f16cbfeb5824 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:13 user nova-compute[75293]: DEBUG nova.compute.manager [req-857f76cf-2441-4363-a7ae-1912f02da70f req-b6dfda86-e476-4179-ae7f-f16cbfeb5824 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] No waiting events found dispatching network-vif-unplugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:19:13 user nova-compute[75293]: WARNING nova.compute.manager [req-857f76cf-2441-4363-a7ae-1912f02da70f req-b6dfda86-e476-4179-ae7f-f16cbfeb5824 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received unexpected event network-vif-unplugged-094f0848-c129-4499-8781-6943982188b6 for instance with vm_state rescued and task_state unrescuing.
Nov 30 07:19:13 user nova-compute[75293]: DEBUG nova.compute.manager [req-857f76cf-2441-4363-a7ae-1912f02da70f req-b6dfda86-e476-4179-ae7f-f16cbfeb5824 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received event network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-857f76cf-2441-4363-a7ae-1912f02da70f req-b6dfda86-e476-4179-ae7f-f16cbfeb5824 service nova] Acquiring lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-857f76cf-2441-4363-a7ae-1912f02da70f req-b6dfda86-e476-4179-ae7f-f16cbfeb5824 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-857f76cf-2441-4363-a7ae-1912f02da70f req-b6dfda86-e476-4179-ae7f-f16cbfeb5824 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:13 user nova-compute[75293]: DEBUG nova.compute.manager [req-857f76cf-2441-4363-a7ae-1912f02da70f req-b6dfda86-e476-4179-ae7f-f16cbfeb5824 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] No waiting events found dispatching network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:19:13 user nova-compute[75293]: WARNING nova.compute.manager [req-857f76cf-2441-4363-a7ae-1912f02da70f req-b6dfda86-e476-4179-ae7f-f16cbfeb5824 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received unexpected event network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 for instance with vm_state rescued and task_state unrescuing.
Nov 30 07:19:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-8226fec7-c0b0-4636-ab67-659dd1542d8a req-30e33503-c865-4109-9694-e75117432f46 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received event network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8226fec7-c0b0-4636-ab67-659dd1542d8a req-30e33503-c865-4109-9694-e75117432f46 service nova] Acquiring lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8226fec7-c0b0-4636-ab67-659dd1542d8a req-30e33503-c865-4109-9694-e75117432f46 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8226fec7-c0b0-4636-ab67-659dd1542d8a req-30e33503-c865-4109-9694-e75117432f46 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-8226fec7-c0b0-4636-ab67-659dd1542d8a req-30e33503-c865-4109-9694-e75117432f46 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] No waiting events found dispatching network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:19:15 user nova-compute[75293]: WARNING nova.compute.manager [req-8226fec7-c0b0-4636-ab67-659dd1542d8a req-30e33503-c865-4109-9694-e75117432f46 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received unexpected event network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 for instance with vm_state rescued and task_state unrescuing.
Nov 30 07:19:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-8226fec7-c0b0-4636-ab67-659dd1542d8a req-30e33503-c865-4109-9694-e75117432f46 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received event network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8226fec7-c0b0-4636-ab67-659dd1542d8a req-30e33503-c865-4109-9694-e75117432f46 service nova] Acquiring lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8226fec7-c0b0-4636-ab67-659dd1542d8a req-30e33503-c865-4109-9694-e75117432f46 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8226fec7-c0b0-4636-ab67-659dd1542d8a req-30e33503-c865-4109-9694-e75117432f46 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-8226fec7-c0b0-4636-ab67-659dd1542d8a req-30e33503-c865-4109-9694-e75117432f46 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] No waiting events found dispatching network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:19:15 user nova-compute[75293]: WARNING nova.compute.manager [req-8226fec7-c0b0-4636-ab67-659dd1542d8a req-30e33503-c865-4109-9694-e75117432f46 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received unexpected event network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 for instance with vm_state rescued and task_state unrescuing.
Nov 30 07:19:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-c4f810e7-46a5-44b2-8bef-0cd39c3f8ea5 req-683eceb2-75b0-4f42-9396-29eae81fbd9f service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Received event network-changed-7ed89ba2-1320-471a-ba57-e161b88f61cf {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-c4f810e7-46a5-44b2-8bef-0cd39c3f8ea5 req-683eceb2-75b0-4f42-9396-29eae81fbd9f service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Refreshing instance network info cache due to event network-changed-7ed89ba2-1320-471a-ba57-e161b88f61cf. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c4f810e7-46a5-44b2-8bef-0cd39c3f8ea5 req-683eceb2-75b0-4f42-9396-29eae81fbd9f service nova] Acquiring lock "refresh_cache-f5162965-1cf1-4f92-86fc-88c1004748c8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c4f810e7-46a5-44b2-8bef-0cd39c3f8ea5 req-683eceb2-75b0-4f42-9396-29eae81fbd9f service nova] Acquired lock "refresh_cache-f5162965-1cf1-4f92-86fc-88c1004748c8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG nova.network.neutron [req-c4f810e7-46a5-44b2-8bef-0cd39c3f8ea5 req-683eceb2-75b0-4f42-9396-29eae81fbd9f service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Refreshing network info cache for port 7ed89ba2-1320-471a-ba57-e161b88f61cf {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG nova.compute.manager [None req-a87ea6fa-37c8-463b-9422-f313849cc067 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "f5162965-1cf1-4f92-86fc-88c1004748c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "f5162965-1cf1-4f92-86fc-88c1004748c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "f5162965-1cf1-4f92-86fc-88c1004748c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "f5162965-1cf1-4f92-86fc-88c1004748c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "f5162965-1cf1-4f92-86fc-88c1004748c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:15 user nova-compute[75293]: INFO nova.compute.manager [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Terminating instance
Nov 30 07:19:15 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG nova.network.neutron [req-c4f810e7-46a5-44b2-8bef-0cd39c3f8ea5 req-683eceb2-75b0-4f42-9396-29eae81fbd9f service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Updated VIF entry in instance network info cache for port 7ed89ba2-1320-471a-ba57-e161b88f61cf. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG nova.network.neutron [req-c4f810e7-46a5-44b2-8bef-0cd39c3f8ea5 req-683eceb2-75b0-4f42-9396-29eae81fbd9f service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Updating instance_info_cache with network_info: [{"id": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "address": "fa:16:3e:d8:ea:c8", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed89ba2-13", "ovs_interfaceid": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c4f810e7-46a5-44b2-8bef-0cd39c3f8ea5 req-683eceb2-75b0-4f42-9396-29eae81fbd9f service nova] Releasing lock "refresh_cache-f5162965-1cf1-4f92-86fc-88c1004748c8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:16 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Instance destroyed successfully.
Nov 30 07:19:16 user nova-compute[75293]: DEBUG nova.objects.instance [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lazy-loading 'resources' on Instance uuid f5162965-1cf1-4f92-86fc-88c1004748c8 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:19:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1421709832',display_name='tempest-AttachVolumeNegativeTest-server-1421709832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1421709832',id=29,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNilbMRWaGvJdBWmq6u/iywUvDErJySkQ/E7z9YgbqijYzBdnbe6nryyr90bRZexzNUwfkUriij/AZr0uvUKLWsE+NklA9AcXqc4mvLQBrQTJbAMLMQg1ZVIM/kFXzBprw==',key_name='tempest-keypair-137756123',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:17:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68ff34b2e2c047319c1fe166c5029790',ramdisk_id='',reservation_id='r-5m667wvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1915468397',owner_user_name='tempest-AttachVolumeNegativeTest-1915468397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:17:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe34a1b2c38472d831ae5d7afa85c77',uuid=f5162965-1cf1-4f92-86fc-88c1004748c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "address": "fa:16:3e:d8:ea:c8", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed89ba2-13", "ovs_interfaceid": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:19:16 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converting VIF {"id": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "address": "fa:16:3e:d8:ea:c8", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed89ba2-13", "ovs_interfaceid": "7ed89ba2-1320-471a-ba57-e161b88f61cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:19:16 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:ea:c8,bridge_name='br-int',has_traffic_filtering=True,id=7ed89ba2-1320-471a-ba57-e161b88f61cf,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed89ba2-13') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:19:16 user nova-compute[75293]: DEBUG os_vif [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:ea:c8,bridge_name='br-int',has_traffic_filtering=True,id=7ed89ba2-1320-471a-ba57-e161b88f61cf,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed89ba2-13') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:19:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ed89ba2-13, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:19:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:19:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b412db85-6999-4831-9190-7d1de5afe213) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:19:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:19:16 user nova-compute[75293]: INFO os_vif [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:ea:c8,bridge_name='br-int',has_traffic_filtering=True,id=7ed89ba2-1320-471a-ba57-e161b88f61cf,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed89ba2-13')
Nov 30 07:19:16 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Deleting instance files /opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8_del
Nov 30 07:19:16 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Deletion of /opt/stack/data/nova/instances/f5162965-1cf1-4f92-86fc-88c1004748c8_del complete
Nov 30 07:19:16 user nova-compute[75293]: INFO nova.compute.manager [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 30 07:19:16 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:19:16 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:19:16 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:19:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:16 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:19:16 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Took 0.74 seconds to deallocate network for instance.
Nov 30 07:19:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-8da6d31d-a7db-42f9-b275-255f98a00281 req-4934e235-1357-402a-82e5-ffd7e6b81c20 service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Received event network-vif-unplugged-7ed89ba2-1320-471a-ba57-e161b88f61cf {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8da6d31d-a7db-42f9-b275-255f98a00281 req-4934e235-1357-402a-82e5-ffd7e6b81c20 service nova] Acquiring lock "f5162965-1cf1-4f92-86fc-88c1004748c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8da6d31d-a7db-42f9-b275-255f98a00281 req-4934e235-1357-402a-82e5-ffd7e6b81c20 service nova] Lock "f5162965-1cf1-4f92-86fc-88c1004748c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8da6d31d-a7db-42f9-b275-255f98a00281 req-4934e235-1357-402a-82e5-ffd7e6b81c20 service nova] Lock "f5162965-1cf1-4f92-86fc-88c1004748c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-8da6d31d-a7db-42f9-b275-255f98a00281 req-4934e235-1357-402a-82e5-ffd7e6b81c20 service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] No waiting events found dispatching network-vif-unplugged-7ed89ba2-1320-471a-ba57-e161b88f61cf {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:19:17 user nova-compute[75293]: WARNING nova.compute.manager [req-8da6d31d-a7db-42f9-b275-255f98a00281 req-4934e235-1357-402a-82e5-ffd7e6b81c20 service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Received unexpected event network-vif-unplugged-7ed89ba2-1320-471a-ba57-e161b88f61cf for instance with vm_state deleted and task_state None.
Nov 30 07:19:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-8da6d31d-a7db-42f9-b275-255f98a00281 req-4934e235-1357-402a-82e5-ffd7e6b81c20 service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Received event network-vif-plugged-7ed89ba2-1320-471a-ba57-e161b88f61cf {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8da6d31d-a7db-42f9-b275-255f98a00281 req-4934e235-1357-402a-82e5-ffd7e6b81c20 service nova] Acquiring lock "f5162965-1cf1-4f92-86fc-88c1004748c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8da6d31d-a7db-42f9-b275-255f98a00281 req-4934e235-1357-402a-82e5-ffd7e6b81c20 service nova] Lock "f5162965-1cf1-4f92-86fc-88c1004748c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8da6d31d-a7db-42f9-b275-255f98a00281 req-4934e235-1357-402a-82e5-ffd7e6b81c20 service nova] Lock "f5162965-1cf1-4f92-86fc-88c1004748c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-8da6d31d-a7db-42f9-b275-255f98a00281 req-4934e235-1357-402a-82e5-ffd7e6b81c20 service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] No waiting events found dispatching network-vif-plugged-7ed89ba2-1320-471a-ba57-e161b88f61cf {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:19:17 user nova-compute[75293]: WARNING nova.compute.manager [req-8da6d31d-a7db-42f9-b275-255f98a00281 req-4934e235-1357-402a-82e5-ffd7e6b81c20 service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Received unexpected event network-vif-plugged-7ed89ba2-1320-471a-ba57-e161b88f61cf for instance with vm_state deleted and task_state None.
Nov 30 07:19:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-8da6d31d-a7db-42f9-b275-255f98a00281 req-4934e235-1357-402a-82e5-ffd7e6b81c20 service nova] [instance: f5162965-1cf1-4f92-86fc-88c1004748c8] Received event network-vif-deleted-7ed89ba2-1320-471a-ba57-e161b88f61cf {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:17 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:19:17 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:19:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:17 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Deleted allocations for instance f5162965-1cf1-4f92-86fc-88c1004748c8
Nov 30 07:19:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d487804a-4dd6-48da-a280-9634325f4099 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "f5162965-1cf1-4f92-86fc-88c1004748c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.972s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:18 user nova-compute[75293]: INFO nova.compute.manager [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Detaching volume aa215221-be93-4787-b37f-56937b1e2238
Nov 30 07:19:18 user nova-compute[75293]: INFO nova.virt.block_device [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Attempting to driver detach volume aa215221-be93-4787-b37f-56937b1e2238 from mountpoint /dev/vdb
Nov 30 07:19:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Attempting to detach device vdb from instance a46f0c4f-4449-47e2-aa1e-a4508c81d768 from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:19:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:19:18 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:19:18 user nova-compute[75293]:   <source dev="/dev/sdg"/>
Nov 30 07:19:18 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:19:18 user nova-compute[75293]:   <serial>aa215221-be93-4787-b37f-56937b1e2238</serial>
Nov 30 07:19:18 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:19:18 user nova-compute[75293]: </disk>
Nov 30 07:19:18 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:19:18 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Successfully detached device vdb from instance a46f0c4f-4449-47e2-aa1e-a4508c81d768 from the persistent domain config.
Nov 30 07:19:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a46f0c4f-4449-47e2-aa1e-a4508c81d768 from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:19:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:19:18 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:19:18 user nova-compute[75293]:   <source dev="/dev/sdg"/>
Nov 30 07:19:18 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:19:18 user nova-compute[75293]:   <serial>aa215221-be93-4787-b37f-56937b1e2238</serial>
Nov 30 07:19:18 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:19:18 user nova-compute[75293]: </disk>
Nov 30 07:19:18 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:19:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a46f0c4f-4449-47e2-aa1e-a4508c81d768 {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:19:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:28 user nova-compute[75293]: DEBUG nova.compute.manager [req-4a4440d9-0f3e-4976-8f2a-2eee270bd9c7 req-66c8e6a9-67d0-4395-a889-7595db97be10 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Received event network-changed-dae8d2c1-7bef-420e-b14b-911f6552261b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:28 user nova-compute[75293]: DEBUG nova.compute.manager [req-4a4440d9-0f3e-4976-8f2a-2eee270bd9c7 req-66c8e6a9-67d0-4395-a889-7595db97be10 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Refreshing instance network info cache due to event network-changed-dae8d2c1-7bef-420e-b14b-911f6552261b. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:19:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4a4440d9-0f3e-4976-8f2a-2eee270bd9c7 req-66c8e6a9-67d0-4395-a889-7595db97be10 service nova] Acquiring lock "refresh_cache-04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:19:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4a4440d9-0f3e-4976-8f2a-2eee270bd9c7 req-66c8e6a9-67d0-4395-a889-7595db97be10 service nova] Acquired lock "refresh_cache-04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:19:28 user nova-compute[75293]: DEBUG nova.network.neutron [req-4a4440d9-0f3e-4976-8f2a-2eee270bd9c7 req-66c8e6a9-67d0-4395-a889-7595db97be10 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Refreshing network info cache for port dae8d2c1-7bef-420e-b14b-911f6552261b {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:19:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:28 user nova-compute[75293]: DEBUG nova.objects.instance [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lazy-loading 'flavor' on Instance uuid 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:19:28 user nova-compute[75293]: DEBUG nova.network.neutron [req-4a4440d9-0f3e-4976-8f2a-2eee270bd9c7 req-66c8e6a9-67d0-4395-a889-7595db97be10 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Updated VIF entry in instance network info cache for port dae8d2c1-7bef-420e-b14b-911f6552261b. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:19:28 user nova-compute[75293]: DEBUG nova.network.neutron [req-4a4440d9-0f3e-4976-8f2a-2eee270bd9c7 req-66c8e6a9-67d0-4395-a889-7595db97be10 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Updating instance_info_cache with network_info: [{"id": "dae8d2c1-7bef-420e-b14b-911f6552261b", "address": "fa:16:3e:d0:1c:74", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae8d2c1-7b", "ovs_interfaceid": "dae8d2c1-7bef-420e-b14b-911f6552261b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:19:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4a4440d9-0f3e-4976-8f2a-2eee270bd9c7 req-66c8e6a9-67d0-4395-a889-7595db97be10 service nova] Releasing lock "refresh_cache-04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:19:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:29 user nova-compute[75293]: INFO nova.compute.manager [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Attaching volume 982ebb19-a2e6-48bd-9fd0-c40d9df44d5d to /dev/vdb
Nov 30 07:19:29 user nova-compute[75293]: DEBUG os_brick.utils [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[930164cc-ce7d-437b-a2e6-c35f961fe969]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[201244d9-27ca-4d9a-b480-64df11e4e2f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[05098188-5760-4018-a0af-b5daf22f2752]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2141f4-2068-47a2-8e3b-2db83e859fff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:19:29 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:19:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bad7a89-7966-4606-afb5-f72d8eba5b08]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG os_brick.utils [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:19:29 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Updating existing volume attachment record: 1025cc2d-ae95-4d19-bf65-1a50e2d40bf1 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:19:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lVMCbypD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:19:37 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:19:37 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:19:37 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[96911bdc-f87b-4fa4-a020-9d6560c253eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:19:37 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed2f25b-6f77-4b77-952c-07c90d9dd5f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d] added
Nov 30 07:19:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[712c0d00-8a8a-4289-bb03-6092c40317db]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f47097-7f6e-46e1-aaac-a58e17a099bd]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lVMCbypD {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lVMCbypD" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16e8f6b-da11-40c5-a44a-d9c8cdc84503]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lVMCbypD'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[33769004-0daa-43ac-876e-8d6b052ebe69]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad70c87e-da53-49dd-9032-b86ed9e73181]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:19:37 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:19:37 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:19:37 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:19:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:19:37 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:19:37 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:19:37 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:19:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[608bdf96-1ab4-4b84-9ab0-4e6207eac276]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d, portal: 172.16.0.220,3260]
Nov 30 07:19:37 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d, portal: 172.16.0.220,3260] successful.
Nov 30 07:19:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1f1f86-f9f5-4665-a66a-12712a01c3e7]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca768c3-4a32-491f-996a-1f4fbe0acb2c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:19:37 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:19:37 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:19:37 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:19:37 user nova-compute[75293]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d (non-flash)
Nov 30 07:19:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:19:37 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:19:37 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:19:37 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:19:37 user nova-compute[75293]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d (non-flash)
Nov 30 07:19:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3118f0da-6aca-4f25-ba0a-eef3a651087d]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:19:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lVMCbypD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23330643237643439', 'path': '/dev/sdb'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330643237643439', 'path': '/dev/sdb'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG nova.objects.instance [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lazy-loading 'flavor' on Instance uuid 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:19:38 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:19:38 user nova-compute[75293]:   <source dev="/dev/sdb"/>
Nov 30 07:19:38 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:19:38 user nova-compute[75293]:   <serial>982ebb19-a2e6-48bd-9fd0-c40d9df44d5d</serial>
Nov 30 07:19:38 user nova-compute[75293]: </disk>
Nov 30 07:19:38 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:19:38 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a46f0c4f-4449-47e2-aa1e-a4508c81d768 is timed out.
Nov 30 07:19:38 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Successfully detached device vdb from instance a46f0c4f-4449-47e2-aa1e-a4508c81d768 from the live domain config.
Nov 30 07:19:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zqHYUPsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:19:38 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:19:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f93e521-0e3f-42ef-8963-bc9bcaffc37e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:19:38 user nova-compute[75293]: No targets found.
Nov 30 07:19:38 user nova-compute[75293]: iSNS:
Nov 30 07:19:38 user nova-compute[75293]: No targets found.
Nov 30 07:19:38 user nova-compute[75293]: STATIC:
Nov 30 07:19:38 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0
Nov 30 07:19:38 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:19:38 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:19:38 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238
Nov 30 07:19:38 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:19:38 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:19:38 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314
Nov 30 07:19:38 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:19:38 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:19:38 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:19:38 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:19:38 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:19:38 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d
Nov 30 07:19:38 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:19:38 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:19:38 user nova-compute[75293]: FIRMWARE:
Nov 30 07:19:38 user nova-compute[75293]: No targets found.
Nov 30 07:19:38 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:19:38 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:19:38 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ae3e33-bf27-4f2f-a78c-bd398ab343c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6912598f-b925-46fa-9d43-ed3d87858e08]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:19:38 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:19:38 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:19:38 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:19:38 user nova-compute[75293]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d (non-flash)
Nov 30 07:19:38 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:19:38 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:19:38 user nova-compute[75293]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 (non-flash)
Nov 30 07:19:38 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:19:38 user nova-compute[75293]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d (non-flash)
Nov 30 07:19:38 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe0132560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238'): ({'sdg'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Removing single pathed devices sdg {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:19:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[199b23d3-75f6-4cc6-9fda-e782734c7532]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4782fe5b-8d32-4969-ae4f-7de3d6e2dad4]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Flushing IO for device /dev/sdg {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d473d5c2-9e51-4ab9-9899-4e9d03956bf7]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3715f2-e13e-4b5f-b7fb-cc2e9e3effd4]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] SCSI volumes sdg have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c135ff-ddd8-4462-adaf-0627e106e10e]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeb2226-f8f9-4663-abca-8b99ac00f3a8]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238, portal: 172.16.0.220,3260]
Nov 30 07:19:39 user nova-compute[75293]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238, portal: 172.16.0.220,3260] successful.
Nov 30 07:19:39 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa215221-be93-4787-b37f-56937b1e2238 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6779d4-5ac2-485c-ba8e-5a65c0d6caf3]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] <== disconnect_volume: return (397ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] No VIF found with MAC fa:16:3e:d0:1c:74, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:19:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f6ac7315-f1fb-4e14-a1c4-0cc178b10719 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.577s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:40 user nova-compute[75293]: DEBUG nova.objects.instance [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lazy-loading 'flavor' on Instance uuid a46f0c4f-4449-47e2-aa1e-a4508c81d768 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:19:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-520e84e2-c5aa-4c07-86d2-25837bb37bb3 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.914s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:40 user nova-compute[75293]: INFO nova.compute.manager [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Detaching volume 982ebb19-a2e6-48bd-9fd0-c40d9df44d5d
Nov 30 07:19:41 user nova-compute[75293]: INFO nova.virt.block_device [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Attempting to driver detach volume 982ebb19-a2e6-48bd-9fd0-c40d9df44d5d from mountpoint /dev/vdb
Nov 30 07:19:41 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Attempting to detach device vdb from instance 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7 from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:19:41 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:19:41 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:19:41 user nova-compute[75293]:   <source dev="/dev/sdb"/>
Nov 30 07:19:41 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:19:41 user nova-compute[75293]:   <serial>982ebb19-a2e6-48bd-9fd0-c40d9df44d5d</serial>
Nov 30 07:19:41 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:19:41 user nova-compute[75293]: </disk>
Nov 30 07:19:41 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:19:41 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Successfully detached device vdb from instance 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7 from the persistent domain config.
Nov 30 07:19:41 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7 from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:19:41 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:19:41 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:19:41 user nova-compute[75293]:   <source dev="/dev/sdb"/>
Nov 30 07:19:41 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:19:41 user nova-compute[75293]:   <serial>982ebb19-a2e6-48bd-9fd0-c40d9df44d5d</serial>
Nov 30 07:19:41 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:19:41 user nova-compute[75293]: </disk>
Nov 30 07:19:41 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:19:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:41 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7 {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:19:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:49 user nova-compute[75293]: DEBUG nova.compute.manager [req-1d02c5a7-17f7-49b2-ad5f-3b41b538b493 req-56e22d55-bebc-4aca-892e-35a9a8695903 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received event network-changed-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:49 user nova-compute[75293]: DEBUG nova.compute.manager [req-1d02c5a7-17f7-49b2-ad5f-3b41b538b493 req-56e22d55-bebc-4aca-892e-35a9a8695903 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Refreshing instance network info cache due to event network-changed-814f9aa9-6974-4b76-96ba-52668f19b3f1. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:19:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1d02c5a7-17f7-49b2-ad5f-3b41b538b493 req-56e22d55-bebc-4aca-892e-35a9a8695903 service nova] Acquiring lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:19:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1d02c5a7-17f7-49b2-ad5f-3b41b538b493 req-56e22d55-bebc-4aca-892e-35a9a8695903 service nova] Acquired lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:19:49 user nova-compute[75293]: DEBUG nova.network.neutron [req-1d02c5a7-17f7-49b2-ad5f-3b41b538b493 req-56e22d55-bebc-4aca-892e-35a9a8695903 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Refreshing network info cache for port 814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "677602ec-88fd-4026-8112-8469855f8a78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "677602ec-88fd-4026-8112-8469855f8a78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "677602ec-88fd-4026-8112-8469855f8a78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "677602ec-88fd-4026-8112-8469855f8a78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "677602ec-88fd-4026-8112-8469855f8a78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:50 user nova-compute[75293]: INFO nova.compute.manager [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Terminating instance
Nov 30 07:19:50 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG nova.compute.manager [req-5202981a-8fb3-4700-96ce-3c3f53c14f1c req-2c95d44f-32f7-4fca-b59a-70806638084d service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received event network-vif-unplugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5202981a-8fb3-4700-96ce-3c3f53c14f1c req-2c95d44f-32f7-4fca-b59a-70806638084d service nova] Acquiring lock "677602ec-88fd-4026-8112-8469855f8a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5202981a-8fb3-4700-96ce-3c3f53c14f1c req-2c95d44f-32f7-4fca-b59a-70806638084d service nova] Lock "677602ec-88fd-4026-8112-8469855f8a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5202981a-8fb3-4700-96ce-3c3f53c14f1c req-2c95d44f-32f7-4fca-b59a-70806638084d service nova] Lock "677602ec-88fd-4026-8112-8469855f8a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG nova.compute.manager [req-5202981a-8fb3-4700-96ce-3c3f53c14f1c req-2c95d44f-32f7-4fca-b59a-70806638084d service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] No waiting events found dispatching network-vif-unplugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG nova.compute.manager [req-5202981a-8fb3-4700-96ce-3c3f53c14f1c req-2c95d44f-32f7-4fca-b59a-70806638084d service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received event network-vif-unplugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG nova.network.neutron [req-1d02c5a7-17f7-49b2-ad5f-3b41b538b493 req-56e22d55-bebc-4aca-892e-35a9a8695903 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Updated VIF entry in instance network info cache for port 814f9aa9-6974-4b76-96ba-52668f19b3f1. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG nova.network.neutron [req-1d02c5a7-17f7-49b2-ad5f-3b41b538b493 req-56e22d55-bebc-4aca-892e-35a9a8695903 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Updating instance_info_cache with network_info: [{"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1d02c5a7-17f7-49b2-ad5f-3b41b538b493 req-56e22d55-bebc-4aca-892e-35a9a8695903 service nova] Releasing lock "refresh_cache-677602ec-88fd-4026-8112-8469855f8a78" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:19:50 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Instance destroyed successfully.
Nov 30 07:19:50 user nova-compute[75293]: DEBUG nova.objects.instance [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lazy-loading 'resources' on Instance uuid 677602ec-88fd-4026-8112-8469855f8a78 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T07:14:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-770610968',display_name='tempest-TestShelveInstance-server-770610968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-770610968',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLM1q2xWwt8nZI6FCB7oMRauNhjDcCuEsDd6hTQ69yj0BH9+/FJi552VJ2tgJb+JE66cg7iUXvN2C/cnao+LM3IbIqZxCcYZKEkU6EmLjbe4gKvpfOHWja2udvl5EpNvCw==',key_name='tempest-TestShelveInstance-816209512',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:18:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb68dc3daea04910bc7f11d6acdd91a6',ramdisk_id='',reservation_id='r-u75fgbpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-620093432',owner_user_name='tempest-TestShelveInstance-620093432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:18:18Z,user_data=None,user_id='1470bbdb1f494cca880294d2e97d3a01',uuid=677602ec-88fd-4026-8112-8469855f8a78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Converting VIF {"id": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "address": "fa:16:3e:60:bb:6e", "network": {"id": "c9521d26-96fd-4c02-88a6-c6cc9d945905", "bridge": "br-int", "label": "tempest-TestShelveInstance-1239425890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb68dc3daea04910bc7f11d6acdd91a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814f9aa9-69", "ovs_interfaceid": "814f9aa9-6974-4b76-96ba-52668f19b3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=814f9aa9-6974-4b76-96ba-52668f19b3f1,network=Network(c9521d26-96fd-4c02-88a6-c6cc9d945905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f9aa9-69') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG os_vif [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=814f9aa9-6974-4b76-96ba-52668f19b3f1,network=Network(c9521d26-96fd-4c02-88a6-c6cc9d945905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f9aa9-69') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap814f9aa9-69, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7990dc0-06d7-434f-909b-1913b73a479e) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:19:50 user nova-compute[75293]: INFO os_vif [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=814f9aa9-6974-4b76-96ba-52668f19b3f1,network=Network(c9521d26-96fd-4c02-88a6-c6cc9d945905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814f9aa9-69')
Nov 30 07:19:50 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YnWrPTdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:19:50 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:19:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a95cac-567b-4a32-9025-8cd0459ea0ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:19:50 user nova-compute[75293]: No targets found.
Nov 30 07:19:50 user nova-compute[75293]: iSNS:
Nov 30 07:19:50 user nova-compute[75293]: No targets found.
Nov 30 07:19:50 user nova-compute[75293]: STATIC:
Nov 30 07:19:50 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0
Nov 30 07:19:50 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:19:50 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:19:50 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314
Nov 30 07:19:50 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:19:50 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:19:50 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:19:50 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:19:50 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:19:50 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d
Nov 30 07:19:50 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:19:50 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:19:50 user nova-compute[75293]: FIRMWARE:
Nov 30 07:19:50 user nova-compute[75293]: No targets found.
Nov 30 07:19:50 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:19:50 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:19:50 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c94731f-82de-4764-af1d-8d7139965d52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c86d78b-75ae-4f3b-abe2-5bbd515d9688]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:19:50 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:19:50 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:19:50 user nova-compute[75293]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d (non-flash)
Nov 30 07:19:50 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:19:50 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:19:50 user nova-compute[75293]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 (non-flash)
Nov 30 07:19:50 user nova-compute[75293]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d (non-flash)
Nov 30 07:19:50 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe0363ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314'): ({'sdh'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Removing single pathed devices sdh {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b069c5-51f6-4605-b172-2c3e35dc7af7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a4dc64-2ba2-439e-806f-ecb5df8f6dee]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Flushing IO for device /dev/sdh {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeae33f-e99a-44d0-9c74-f007a2ad166d]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[341960a9-14ef-4980-a95c-1da43cb2e097]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] SCSI volumes sdh have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_38a15572', '/dev/disk/by-id/scsi-23132346530656130', '/dev/disk/by-id/scsi-1SCST_BIO38a15572-124e0ea06f0589f7') {{(pid=86417) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 07:19:51 user nova-compute[75293]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_38a15572
Nov 30 07:19:51 user nova-compute[75293]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23132346530656130
Nov 30 07:19:51 user nova-compute[75293]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO38a15572-124e0ea06f0589f7
Nov 30 07:19:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef695e4-0516-4e30-bdc2-b192c2ba855f]: (4, None) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5e7ddc-bc20-40c9-85c0-cfaf259d1705]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e3776c-70e2-4fcb-b7af-60433531147c]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314, portal: 172.16.0.220,3260]
Nov 30 07:19:51 user nova-compute[75293]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314, portal: 172.16.0.220,3260] successful.
Nov 30 07:19:51 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2b1463-7536-4ea8-9576-419ceeeb8314 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a472ffe9-08e0-4b84-8fb6-7b6f78970b28]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] <== disconnect_volume: return (347ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:19:51 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Deleting instance files /opt/stack/data/nova/instances/677602ec-88fd-4026-8112-8469855f8a78_del
Nov 30 07:19:51 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Deletion of /opt/stack/data/nova/instances/677602ec-88fd-4026-8112-8469855f8a78_del complete
Nov 30 07:19:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:51 user nova-compute[75293]: INFO nova.compute.manager [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 30 07:19:51 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 677602ec-88fd-4026-8112-8469855f8a78] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:19:51 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Took 0.46 seconds to deallocate network for instance.
Nov 30 07:19:51 user nova-compute[75293]: DEBUG nova.compute.manager [req-aa33f392-6563-46ee-adca-f18972591173 req-0e04bbf9-e50c-44e1-a1c7-32c81fc25f39 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received event network-vif-deleted-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:51 user nova-compute[75293]: INFO nova.compute.manager [req-aa33f392-6563-46ee-adca-f18972591173 req-0e04bbf9-e50c-44e1-a1c7-32c81fc25f39 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Neutron deleted interface 814f9aa9-6974-4b76-96ba-52668f19b3f1; detaching it from the instance and deleting it from the info cache
Nov 30 07:19:51 user nova-compute[75293]: DEBUG nova.network.neutron [req-aa33f392-6563-46ee-adca-f18972591173 req-0e04bbf9-e50c-44e1-a1c7-32c81fc25f39 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:19:51 user nova-compute[75293]: DEBUG nova.compute.manager [req-aa33f392-6563-46ee-adca-f18972591173 req-0e04bbf9-e50c-44e1-a1c7-32c81fc25f39 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Detach interface failed, port_id=814f9aa9-6974-4b76-96ba-52668f19b3f1, reason: Instance 677602ec-88fd-4026-8112-8469855f8a78 could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:19:52 user nova-compute[75293]: DEBUG nova.compute.manager [req-d0e296a7-70dd-4937-93d2-d480a83b58cd req-97bcb03d-318b-48ad-a919-813fdb9449f7 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received event network-vif-plugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:19:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d0e296a7-70dd-4937-93d2-d480a83b58cd req-97bcb03d-318b-48ad-a919-813fdb9449f7 service nova] Acquiring lock "677602ec-88fd-4026-8112-8469855f8a78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d0e296a7-70dd-4937-93d2-d480a83b58cd req-97bcb03d-318b-48ad-a919-813fdb9449f7 service nova] Lock "677602ec-88fd-4026-8112-8469855f8a78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d0e296a7-70dd-4937-93d2-d480a83b58cd req-97bcb03d-318b-48ad-a919-813fdb9449f7 service nova] Lock "677602ec-88fd-4026-8112-8469855f8a78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:52 user nova-compute[75293]: DEBUG nova.compute.manager [req-d0e296a7-70dd-4937-93d2-d480a83b58cd req-97bcb03d-318b-48ad-a919-813fdb9449f7 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] No waiting events found dispatching network-vif-plugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:19:52 user nova-compute[75293]: WARNING nova.compute.manager [req-d0e296a7-70dd-4937-93d2-d480a83b58cd req-97bcb03d-318b-48ad-a919-813fdb9449f7 service nova] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Received unexpected event network-vif-plugged-814f9aa9-6974-4b76-96ba-52668f19b3f1 for instance with vm_state active and task_state deleting.
Nov 30 07:19:52 user nova-compute[75293]: INFO nova.compute.manager [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Took 0.77 seconds to detach 1 volumes for instance.
Nov 30 07:19:52 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] [instance: 677602ec-88fd-4026-8112-8469855f8a78] Deleting volume: 9f2b1463-7536-4ea8-9576-419ceeeb8314 {{(pid=75293) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 07:19:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:52 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:19:52 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:19:52 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:19:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:53 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Deleted allocations for instance 677602ec-88fd-4026-8112-8469855f8a78
Nov 30 07:19:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c4b8eb1-d717-4b68-962a-72e334c69428 tempest-TestShelveInstance-620093432 tempest-TestShelveInstance-620093432-project-member] Lock "677602ec-88fd-4026-8112-8469855f8a78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.090s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:53 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:19:53 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:19:54 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:19:54 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:19:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-d34f99fc-343e-4e8a-83e6-372b0326bded" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:19:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-d34f99fc-343e-4e8a-83e6-372b0326bded" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:19:54 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:19:55 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Updating instance_info_cache with network_info: [{"id": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "address": "fa:16:3e:d8:cd:81", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47caadd-df", "ovs_interfaceid": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:19:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-d34f99fc-343e-4e8a-83e6-372b0326bded" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:19:55 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:19:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:19:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:19:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:19:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:19:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:19:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:19:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:19:56 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:19:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:19:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:19:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:19:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:20:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:00 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:20:00 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:20:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=7535MB free_disk=24.870521545410156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:20:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 1b7deb0a-39af-4d93-b93d-5765a731f702 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance c8d1df78-2aa2-4710-a570-5f72c60cfc26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance d34f99fc-343e-4e8a-83e6-372b0326bded actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 4be43bb1-b17c-40b9-953a-c820f2396176 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance ed037c80-4f33-4e03-907c-18b4ea122411 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance a46f0c4f-4449-47e2-aa1e-a4508c81d768 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 39042069-ac9b-4b13-b486-c845e84ac041 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 4ebf0be9-15e0-418c-a554-7885c79a725b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:01 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7 is timed out.
Nov 30 07:20:01 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Successfully detached device vdb from instance 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7 from the live domain config.
Nov 30 07:20:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lVMCbypD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:20:01 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bc0694-b3e0-4e44-830b-d4464f8c2d89]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:20:01 user nova-compute[75293]: No targets found.
Nov 30 07:20:01 user nova-compute[75293]: iSNS:
Nov 30 07:20:01 user nova-compute[75293]: No targets found.
Nov 30 07:20:01 user nova-compute[75293]: STATIC:
Nov 30 07:20:01 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0
Nov 30 07:20:01 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:20:01 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:20:01 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:20:01 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:20:01 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:20:01 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d
Nov 30 07:20:01 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:20:01 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:20:01 user nova-compute[75293]: FIRMWARE:
Nov 30 07:20:01 user nova-compute[75293]: No targets found.
Nov 30 07:20:01 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:20:01 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:20:01 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "39042069-ac9b-4b13-b486-c845e84ac041" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "39042069-ac9b-4b13-b486-c845e84ac041" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "39042069-ac9b-4b13-b486-c845e84ac041-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2d390a-431d-4456-9670-ddf71e256e7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:01 user nova-compute[75293]: INFO nova.compute.manager [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Terminating instance
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5cb51d-e4e8-43d2-9c2e-b239ca320784]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:20:01 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:20:01 user nova-compute[75293]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d (non-flash)
Nov 30 07:20:01 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:20:01 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:20:01 user nova-compute[75293]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d (non-flash)
Nov 30 07:20:01 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe804f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d'): ({'sdb'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Removing single pathed devices sdb {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac516aef-ec4c-468b-93c2-f96af3d765a8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddf9f87-2f5a-41b7-8136-7d829c2cf1ac]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Flushing IO for device /dev/sdb {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9423297-bf02-478c-bd39-4c29deb83d8c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c8b55c-3c9b-4e2b-b32e-b268cd221521]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[827a1d39-ca06-4ce3-8c66-f17040fb5390]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.105s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81a9ba7-aa50-49c2-94ba-08c433f25976]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d, portal: 172.16.0.220,3260]
Nov 30 07:20:01 user nova-compute[75293]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d, portal: 172.16.0.220,3260] successful.
Nov 30 07:20:01 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:982ebb19-a2e6-48bd-9fd0-c40d9df44d5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe20a790-56d7-48a6-8dbf-d0b2f8887850]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] <== disconnect_volume: return (403ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:20:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG nova.compute.manager [req-4254e60e-7e4a-45d1-b124-f22f77954aae req-4023f92e-a10a-474c-8a30-acaeba29ad7c service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received event network-vif-unplugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4254e60e-7e4a-45d1-b124-f22f77954aae req-4023f92e-a10a-474c-8a30-acaeba29ad7c service nova] Acquiring lock "39042069-ac9b-4b13-b486-c845e84ac041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4254e60e-7e4a-45d1-b124-f22f77954aae req-4023f92e-a10a-474c-8a30-acaeba29ad7c service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4254e60e-7e4a-45d1-b124-f22f77954aae req-4023f92e-a10a-474c-8a30-acaeba29ad7c service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG nova.compute.manager [req-4254e60e-7e4a-45d1-b124-f22f77954aae req-4023f92e-a10a-474c-8a30-acaeba29ad7c service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] No waiting events found dispatching network-vif-unplugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG nova.compute.manager [req-4254e60e-7e4a-45d1-b124-f22f77954aae req-4023f92e-a10a-474c-8a30-acaeba29ad7c service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received event network-vif-unplugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:20:02 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Instance destroyed successfully.
Nov 30 07:20:02 user nova-compute[75293]: DEBUG nova.objects.instance [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lazy-loading 'resources' on Instance uuid 39042069-ac9b-4b13-b486-c845e84ac041 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-30T07:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1239175050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1239175050',id=20,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzh49xi4NKMy4+Uk32rDD+TSdJf8Z6DRpGQmUiy7rQ8et62Zs3i28YpatQsKbwR1lGArGLXID3uOAjriRvxQM2+wm39B3BWMLufpvqn6wVgUGwByVJFVVsJ7v/OaR0ZEQ==',key_name='tempest-keypair-1386254430',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:18:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18aa2f5bea3d44ecb10ff083d6f76038',ramdisk_id='',reservation_id='r-j3ig0f6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-763079906',owner_user_name='tempest-AttachVolumeShelveTestJSON-763079906-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e385a89f913645dd9fd2770e6e7445da',uuid=39042069-ac9b-4b13-b486-c845e84ac041,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converting VIF {"id": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "address": "fa:16:3e:a9:6e:1e", "network": {"id": "02653a3b-cd58-46b9-8981-fc1af951c34f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-132664229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18aa2f5bea3d44ecb10ff083d6f76038", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b39fc27-6f", "ovs_interfaceid": "0b39fc27-6fcb-4dfe-b948-2d0f4f172b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=0b39fc27-6fcb-4dfe-b948-2d0f4f172b48,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b39fc27-6f') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG os_vif [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=0b39fc27-6fcb-4dfe-b948-2d0f4f172b48,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b39fc27-6f') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b39fc27-6f, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31d0e6b9-719a-4170-8372-0b543bf6ba8e) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:02 user nova-compute[75293]: INFO os_vif [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=0b39fc27-6fcb-4dfe-b948-2d0f4f172b48,network=Network(02653a3b-cd58-46b9-8981-fc1af951c34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b39fc27-6f')
Nov 30 07:20:02 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Deleting instance files /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041_del
Nov 30 07:20:02 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Deletion of /opt/stack/data/nova/instances/39042069-ac9b-4b13-b486-c845e84ac041_del complete
Nov 30 07:20:02 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:20:02 user nova-compute[75293]: INFO nova.compute.manager [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Took 0.80 seconds to destroy the instance on the hypervisor.
Nov 30 07:20:02 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG nova.objects.instance [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lazy-loading 'flavor' on Instance uuid 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-747de6a9-b424-49d8-98fb-c51103cfc03c tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.928s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:03 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:20:03 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Took 1.09 seconds to deallocate network for instance.
Nov 30 07:20:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:03 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:20:03 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:20:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:03 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Deleted allocations for instance 39042069-ac9b-4b13-b486-c845e84ac041
Nov 30 07:20:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ecd54004-ee89-4f6c-b52a-839c7507089a tempest-AttachVolumeShelveTestJSON-763079906 tempest-AttachVolumeShelveTestJSON-763079906-project-member] Lock "39042069-ac9b-4b13-b486-c845e84ac041" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.510s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-29867644-4fdc-4343-baec-25f7c08bf4fa req-3af94a6e-b705-4919-b2e9-24194a9c13b9 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received event network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:20:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-29867644-4fdc-4343-baec-25f7c08bf4fa req-3af94a6e-b705-4919-b2e9-24194a9c13b9 service nova] Acquiring lock "39042069-ac9b-4b13-b486-c845e84ac041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-29867644-4fdc-4343-baec-25f7c08bf4fa req-3af94a6e-b705-4919-b2e9-24194a9c13b9 service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-29867644-4fdc-4343-baec-25f7c08bf4fa req-3af94a6e-b705-4919-b2e9-24194a9c13b9 service nova] Lock "39042069-ac9b-4b13-b486-c845e84ac041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-29867644-4fdc-4343-baec-25f7c08bf4fa req-3af94a6e-b705-4919-b2e9-24194a9c13b9 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] No waiting events found dispatching network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:20:04 user nova-compute[75293]: WARNING nova.compute.manager [req-29867644-4fdc-4343-baec-25f7c08bf4fa req-3af94a6e-b705-4919-b2e9-24194a9c13b9 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received unexpected event network-vif-plugged-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 for instance with vm_state deleted and task_state None.
Nov 30 07:20:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-29867644-4fdc-4343-baec-25f7c08bf4fa req-3af94a6e-b705-4919-b2e9-24194a9c13b9 service nova] [instance: 39042069-ac9b-4b13-b486-c845e84ac041] Received event network-vif-deleted-0b39fc27-6fcb-4dfe-b948-2d0f4f172b48 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:20:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "4be43bb1-b17c-40b9-953a-c820f2396176" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "4be43bb1-b17c-40b9-953a-c820f2396176" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:07 user nova-compute[75293]: INFO nova.compute.manager [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Detaching volume 0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0
Nov 30 07:20:07 user nova-compute[75293]: INFO nova.virt.block_device [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Attempting to driver detach volume 0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 from mountpoint /dev/vdb
Nov 30 07:20:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Attempting to detach device vdb from instance 4be43bb1-b17c-40b9-953a-c820f2396176 from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:20:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:20:07 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:20:07 user nova-compute[75293]:   <source dev="/dev/sdc"/>
Nov 30 07:20:07 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:20:07 user nova-compute[75293]:   <serial>0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0</serial>
Nov 30 07:20:07 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:20:07 user nova-compute[75293]: </disk>
Nov 30 07:20:07 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:20:07 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Successfully detached device vdb from instance 4be43bb1-b17c-40b9-953a-c820f2396176 from the persistent domain config.
Nov 30 07:20:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4be43bb1-b17c-40b9-953a-c820f2396176 from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:20:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:20:07 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:20:07 user nova-compute[75293]:   <source dev="/dev/sdc"/>
Nov 30 07:20:07 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:20:07 user nova-compute[75293]:   <serial>0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0</serial>
Nov 30 07:20:07 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:20:07 user nova-compute[75293]: </disk>
Nov 30 07:20:07 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:20:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4be43bb1-b17c-40b9-953a-c820f2396176 {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:20:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:08 user nova-compute[75293]: INFO nova.compute.manager [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Terminating instance
Nov 30 07:20:08 user nova-compute[75293]: DEBUG nova.compute.manager [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:20:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:09 user nova-compute[75293]: DEBUG nova.compute.manager [req-e9b54020-ed95-4175-940e-95cf5909949a req-9aab1610-d1bf-466d-b19f-00be686301a8 service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Received event network-vif-unplugged-cbfcdcde-3eb5-4718-9e72-f0bc28211827 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:20:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e9b54020-ed95-4175-940e-95cf5909949a req-9aab1610-d1bf-466d-b19f-00be686301a8 service nova] Acquiring lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e9b54020-ed95-4175-940e-95cf5909949a req-9aab1610-d1bf-466d-b19f-00be686301a8 service nova] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e9b54020-ed95-4175-940e-95cf5909949a req-9aab1610-d1bf-466d-b19f-00be686301a8 service nova] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:09 user nova-compute[75293]: DEBUG nova.compute.manager [req-e9b54020-ed95-4175-940e-95cf5909949a req-9aab1610-d1bf-466d-b19f-00be686301a8 service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] No waiting events found dispatching network-vif-unplugged-cbfcdcde-3eb5-4718-9e72-f0bc28211827 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:20:09 user nova-compute[75293]: DEBUG nova.compute.manager [req-e9b54020-ed95-4175-940e-95cf5909949a req-9aab1610-d1bf-466d-b19f-00be686301a8 service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Received event network-vif-unplugged-cbfcdcde-3eb5-4718-9e72-f0bc28211827 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:20:09 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Instance destroyed successfully.
Nov 30 07:20:09 user nova-compute[75293]: DEBUG nova.objects.instance [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lazy-loading 'resources' on Instance uuid a46f0c4f-4449-47e2-aa1e-a4508c81d768 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:20:09 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:16:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1952813352',display_name='tempest-TestServerVolumeAttachmentScenario-server-1952813352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1952813352',id=27,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKza/CpmCdEeihVeNtrVo4urRHcv8jPCLi0kKb8EG/2IVYf9BnUDzgL1h3IJ5jIDgIzCbfzdSfFFzjLw0ZftKfXaZOzDdkaLtbrJyvnpX4MRuXtvaDW/X079lBbxDaD0WQ==',key_name='tempest-keypair-2053072957',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:16:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c2bfbd8ed6e440cae055aa384db6ae5',ramdisk_id='',reservation_id='r-jh5cmiab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-145588257',owner_user_name='tempest-TestServerVolumeAttachmentScenario-145588257-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:16:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e489f4b647647a7920d2389a7ea3e1d',uuid=a46f0c4f-4449-47e2-aa1e-a4508c81d768,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "address": "fa:16:3e:57:b9:0d", "network": {"id": "a1600e76-0910-4c90-8474-0f0152873c7e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1517603206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2bfbd8ed6e440cae055aa384db6ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfcdcde-3e", "ovs_interfaceid": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:20:09 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Converting VIF {"id": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "address": "fa:16:3e:57:b9:0d", "network": {"id": "a1600e76-0910-4c90-8474-0f0152873c7e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1517603206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2bfbd8ed6e440cae055aa384db6ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbfcdcde-3e", "ovs_interfaceid": "cbfcdcde-3eb5-4718-9e72-f0bc28211827", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:20:09 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=cbfcdcde-3eb5-4718-9e72-f0bc28211827,network=Network(a1600e76-0910-4c90-8474-0f0152873c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbfcdcde-3e') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:20:09 user nova-compute[75293]: DEBUG os_vif [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=cbfcdcde-3eb5-4718-9e72-f0bc28211827,network=Network(a1600e76-0910-4c90-8474-0f0152873c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbfcdcde-3e') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:20:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbfcdcde-3e, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:20:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:20:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e254fdc3-abcd-4cc2-b86e-af6365b00bba) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:20:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:20:09 user nova-compute[75293]: INFO os_vif [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=cbfcdcde-3eb5-4718-9e72-f0bc28211827,network=Network(a1600e76-0910-4c90-8474-0f0152873c7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbfcdcde-3e')
Nov 30 07:20:09 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Deleting instance files /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768_del
Nov 30 07:20:09 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Deletion of /opt/stack/data/nova/instances/a46f0c4f-4449-47e2-aa1e-a4508c81d768_del complete
Nov 30 07:20:09 user nova-compute[75293]: INFO nova.compute.manager [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 30 07:20:09 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:20:09 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:20:09 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:20:10 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:20:10 user nova-compute[75293]: DEBUG nova.compute.manager [req-4ad27a77-0431-40aa-b721-d9161f1871df req-c8d8f80e-779a-4825-aece-2a6d4ea32f7b service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Received event network-vif-deleted-cbfcdcde-3eb5-4718-9e72-f0bc28211827 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:20:10 user nova-compute[75293]: INFO nova.compute.manager [req-4ad27a77-0431-40aa-b721-d9161f1871df req-c8d8f80e-779a-4825-aece-2a6d4ea32f7b service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Neutron deleted interface cbfcdcde-3eb5-4718-9e72-f0bc28211827; detaching it from the instance and deleting it from the info cache
Nov 30 07:20:10 user nova-compute[75293]: DEBUG nova.network.neutron [req-4ad27a77-0431-40aa-b721-d9161f1871df req-c8d8f80e-779a-4825-aece-2a6d4ea32f7b service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:20:10 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Took 0.82 seconds to deallocate network for instance.
Nov 30 07:20:10 user nova-compute[75293]: DEBUG nova.compute.manager [req-4ad27a77-0431-40aa-b721-d9161f1871df req-c8d8f80e-779a-4825-aece-2a6d4ea32f7b service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Detach interface failed, port_id=cbfcdcde-3eb5-4718-9e72-f0bc28211827, reason: Instance a46f0c4f-4449-47e2-aa1e-a4508c81d768 could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:20:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:10 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:20:10 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:20:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:10 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Deleted allocations for instance a46f0c4f-4449-47e2-aa1e-a4508c81d768
Nov 30 07:20:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-972f8ad1-faaa-47e3-ace0-ef32d5107882 tempest-TestServerVolumeAttachmentScenario-145588257 tempest-TestServerVolumeAttachmentScenario-145588257-project-member] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.183s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-67796957-bb4d-444e-ad71-ac26b13b586e req-d55d448c-da44-42f4-a972-7ce7a509cf5d service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Received event network-vif-plugged-cbfcdcde-3eb5-4718-9e72-f0bc28211827 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:20:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-67796957-bb4d-444e-ad71-ac26b13b586e req-d55d448c-da44-42f4-a972-7ce7a509cf5d service nova] Acquiring lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-67796957-bb4d-444e-ad71-ac26b13b586e req-d55d448c-da44-42f4-a972-7ce7a509cf5d service nova] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-67796957-bb4d-444e-ad71-ac26b13b586e req-d55d448c-da44-42f4-a972-7ce7a509cf5d service nova] Lock "a46f0c4f-4449-47e2-aa1e-a4508c81d768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-67796957-bb4d-444e-ad71-ac26b13b586e req-d55d448c-da44-42f4-a972-7ce7a509cf5d service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] No waiting events found dispatching network-vif-plugged-cbfcdcde-3eb5-4718-9e72-f0bc28211827 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:20:11 user nova-compute[75293]: WARNING nova.compute.manager [req-67796957-bb4d-444e-ad71-ac26b13b586e req-d55d448c-da44-42f4-a972-7ce7a509cf5d service nova] [instance: a46f0c4f-4449-47e2-aa1e-a4508c81d768] Received unexpected event network-vif-plugged-cbfcdcde-3eb5-4718-9e72-f0bc28211827 for instance with vm_state deleted and task_state None.
Nov 30 07:20:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:21 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:20:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:22 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:20:22 user nova-compute[75293]: INFO nova.compute.claims [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Claim successful on node user
Nov 30 07:20:22 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:20:22 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:20:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:22 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:20:22 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:20:22 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:20:22 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:20:22 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:20:22 user nova-compute[75293]: DEBUG nova.policy [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a86d36e3fa88466d9a047e9370468ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f979cf6621554018bbb90c09afd87c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:20:22 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:20:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:20:22 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Creating image(s)
Nov 30 07:20:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "/opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "/opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.186s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.208s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk 1073741824" returned: 0 in 0.047s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.178s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Successfully created port: 546018e5-13f4-4368-abb5-a0cfa3355314 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Cannot resize image /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Ensure instance console log exists: /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Successfully updated port: 546018e5-13f4-4368-abb5-a0cfa3355314 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "refresh_cache-ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquired lock "refresh_cache-ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:20:23 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-e96cb5cf-37a0-41a2-82b8-1c2ed4c3b06a req-8b71d844-a44e-4636-a99d-2ea6efca6bab service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Received event network-changed-546018e5-13f4-4368-abb5-a0cfa3355314 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-e96cb5cf-37a0-41a2-82b8-1c2ed4c3b06a req-8b71d844-a44e-4636-a99d-2ea6efca6bab service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Refreshing instance network info cache due to event network-changed-546018e5-13f4-4368-abb5-a0cfa3355314. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e96cb5cf-37a0-41a2-82b8-1c2ed4c3b06a req-8b71d844-a44e-4636-a99d-2ea6efca6bab service nova] Acquiring lock "refresh_cache-ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Updating instance_info_cache with network_info: [{"id": "546018e5-13f4-4368-abb5-a0cfa3355314", "address": "fa:16:3e:c9:32:7a", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546018e5-13", "ovs_interfaceid": "546018e5-13f4-4368-abb5-a0cfa3355314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Releasing lock "refresh_cache-ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Instance network_info: |[{"id": "546018e5-13f4-4368-abb5-a0cfa3355314", "address": "fa:16:3e:c9:32:7a", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546018e5-13", "ovs_interfaceid": "546018e5-13f4-4368-abb5-a0cfa3355314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e96cb5cf-37a0-41a2-82b8-1c2ed4c3b06a req-8b71d844-a44e-4636-a99d-2ea6efca6bab service nova] Acquired lock "refresh_cache-ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.network.neutron [req-e96cb5cf-37a0-41a2-82b8-1c2ed4c3b06a req-8b71d844-a44e-4636-a99d-2ea6efca6bab service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Refreshing network info cache for port 546018e5-13f4-4368-abb5-a0cfa3355314 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Start _get_guest_xml network_info=[{"id": "546018e5-13f4-4368-abb5-a0cfa3355314", "address": "fa:16:3e:c9:32:7a", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546018e5-13", "ovs_interfaceid": "546018e5-13f4-4368-abb5-a0cfa3355314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:20:24 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:20:24 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:20:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1273885825',display_name='tempest-VolumesSnapshotTestJSON-instance-1273885825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1273885825',id=33,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaWu44EGhs7xcoiw5q03sxrrzvJRo4GX+UML37DFSPQmFWvLM0Uf+j9hq7MrpTyrS749yQFC6dfIJvlEqtXxTh968GJ+A0LTOaQ34u61ffMDjpXetYAMOESGNoLb1sUfQ==',key_name='tempest-keypair-1921930209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f979cf6621554018bbb90c09afd87c5a',ramdisk_id='',reservation_id='r-rp2pb4qn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-73863621',owner_user_name='tempest-VolumesSnapshotTestJSON-73863621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:20:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a86d36e3fa88466d9a047e9370468ecc',uuid=ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "546018e5-13f4-4368-abb5-a0cfa3355314", "address": "fa:16:3e:c9:32:7a", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546018e5-13", "ovs_interfaceid": "546018e5-13f4-4368-abb5-a0cfa3355314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Converting VIF {"id": "546018e5-13f4-4368-abb5-a0cfa3355314", "address": "fa:16:3e:c9:32:7a", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546018e5-13", "ovs_interfaceid": "546018e5-13f4-4368-abb5-a0cfa3355314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:32:7a,bridge_name='br-int',has_traffic_filtering=True,id=546018e5-13f4-4368-abb5-a0cfa3355314,network=Network(0f103825-2792-47bf-b5e2-1108396c6212),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap546018e5-13') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lazy-loading 'pci_devices' on Instance uuid ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:20:24 user nova-compute[75293]:   <uuid>ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8</uuid>
Nov 30 07:20:24 user nova-compute[75293]:   <name>instance-00000021</name>
Nov 30 07:20:24 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:20:24 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:20:24 user nova-compute[75293]:   <metadata>
Nov 30 07:20:24 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:20:24 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:20:24 user nova-compute[75293]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1273885825</nova:name>
Nov 30 07:20:24 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:20:24</nova:creationTime>
Nov 30 07:20:24 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:20:24 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:20:24 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:20:24 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:20:24 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:20:24 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:20:24 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:20:24 user nova-compute[75293]:       <nova:owner>
Nov 30 07:20:24 user nova-compute[75293]:         <nova:user uuid="a86d36e3fa88466d9a047e9370468ecc">tempest-VolumesSnapshotTestJSON-73863621-project-member</nova:user>
Nov 30 07:20:24 user nova-compute[75293]:         <nova:project uuid="f979cf6621554018bbb90c09afd87c5a">tempest-VolumesSnapshotTestJSON-73863621</nova:project>
Nov 30 07:20:24 user nova-compute[75293]:       </nova:owner>
Nov 30 07:20:24 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:20:24 user nova-compute[75293]:       <nova:ports>
Nov 30 07:20:24 user nova-compute[75293]:         <nova:port uuid="546018e5-13f4-4368-abb5-a0cfa3355314">
Nov 30 07:20:24 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 30 07:20:24 user nova-compute[75293]:         </nova:port>
Nov 30 07:20:24 user nova-compute[75293]:       </nova:ports>
Nov 30 07:20:24 user nova-compute[75293]:     </nova:instance>
Nov 30 07:20:24 user nova-compute[75293]:   </metadata>
Nov 30 07:20:24 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:20:24 user nova-compute[75293]:     <system>
Nov 30 07:20:24 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:20:24 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:20:24 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:20:24 user nova-compute[75293]:       <entry name="serial">ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8</entry>
Nov 30 07:20:24 user nova-compute[75293]:       <entry name="uuid">ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8</entry>
Nov 30 07:20:24 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:20:24 user nova-compute[75293]:     </system>
Nov 30 07:20:24 user nova-compute[75293]:   </sysinfo>
Nov 30 07:20:24 user nova-compute[75293]:   <os>
Nov 30 07:20:24 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:20:24 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:20:24 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:20:24 user nova-compute[75293]:   </os>
Nov 30 07:20:24 user nova-compute[75293]:   <features>
Nov 30 07:20:24 user nova-compute[75293]:     <acpi/>
Nov 30 07:20:24 user nova-compute[75293]:     <apic/>
Nov 30 07:20:24 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:20:24 user nova-compute[75293]:   </features>
Nov 30 07:20:24 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:20:24 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:20:24 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:20:24 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:20:24 user nova-compute[75293]:   </clock>
Nov 30 07:20:24 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:20:24 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:20:24 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:20:24 user nova-compute[75293]:   </cpu>
Nov 30 07:20:24 user nova-compute[75293]:   <devices>
Nov 30 07:20:24 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:20:24 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:20:24 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk"/>
Nov 30 07:20:24 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:20:24 user nova-compute[75293]:     </disk>
Nov 30 07:20:24 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:20:24 user nova-compute[75293]:       <mac address="fa:16:3e:c9:32:7a"/>
Nov 30 07:20:24 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:20:24 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:20:24 user nova-compute[75293]:       <target dev="tap546018e5-13"/>
Nov 30 07:20:24 user nova-compute[75293]:     </interface>
Nov 30 07:20:24 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:20:24 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/console.log" append="off"/>
Nov 30 07:20:24 user nova-compute[75293]:     </serial>
Nov 30 07:20:24 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:20:24 user nova-compute[75293]:     <video>
Nov 30 07:20:24 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:20:24 user nova-compute[75293]:     </video>
Nov 30 07:20:24 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:20:24 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:20:24 user nova-compute[75293]:     </rng>
Nov 30 07:20:24 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:20:24 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:20:24 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:20:24 user nova-compute[75293]:     </memballoon>
Nov 30 07:20:24 user nova-compute[75293]:   </devices>
Nov 30 07:20:24 user nova-compute[75293]: </domain>
Nov 30 07:20:24 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:20:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1273885825',display_name='tempest-VolumesSnapshotTestJSON-instance-1273885825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1273885825',id=33,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaWu44EGhs7xcoiw5q03sxrrzvJRo4GX+UML37DFSPQmFWvLM0Uf+j9hq7MrpTyrS749yQFC6dfIJvlEqtXxTh968GJ+A0LTOaQ34u61ffMDjpXetYAMOESGNoLb1sUfQ==',key_name='tempest-keypair-1921930209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f979cf6621554018bbb90c09afd87c5a',ramdisk_id='',reservation_id='r-rp2pb4qn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-73863621',owner_user_name='tempest-VolumesSnapshotTestJSON-73863621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:20:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a86d36e3fa88466d9a047e9370468ecc',uuid=ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "546018e5-13f4-4368-abb5-a0cfa3355314", "address": "fa:16:3e:c9:32:7a", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546018e5-13", "ovs_interfaceid": "546018e5-13f4-4368-abb5-a0cfa3355314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Converting VIF {"id": "546018e5-13f4-4368-abb5-a0cfa3355314", "address": "fa:16:3e:c9:32:7a", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546018e5-13", "ovs_interfaceid": "546018e5-13f4-4368-abb5-a0cfa3355314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:32:7a,bridge_name='br-int',has_traffic_filtering=True,id=546018e5-13f4-4368-abb5-a0cfa3355314,network=Network(0f103825-2792-47bf-b5e2-1108396c6212),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap546018e5-13') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG os_vif [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:32:7a,bridge_name='br-int',has_traffic_filtering=True,id=546018e5-13f4-4368-abb5-a0cfa3355314,network=Network(0f103825-2792-47bf-b5e2-1108396c6212),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap546018e5-13') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72866170-309e-5477-b55b-a603f4c3f4cb', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap546018e5-13, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap546018e5-13, col_values=(('qos', UUID('d13cb472-01f6-4556-8e95-afa334ea0e8c')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap546018e5-13, col_values=(('external_ids', {'iface-id': '546018e5-13f4-4368-abb5-a0cfa3355314', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:32:7a', 'vm-uuid': 'ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:24 user nova-compute[75293]: INFO os_vif [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:32:7a,bridge_name='br-int',has_traffic_filtering=True,id=546018e5-13f4-4368-abb5-a0cfa3355314,network=Network(0f103825-2792-47bf-b5e2-1108396c6212),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap546018e5-13')
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:20:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] No VIF found with MAC fa:16:3e:c9:32:7a, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:20:25 user nova-compute[75293]: DEBUG nova.network.neutron [req-e96cb5cf-37a0-41a2-82b8-1c2ed4c3b06a req-8b71d844-a44e-4636-a99d-2ea6efca6bab service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Updated VIF entry in instance network info cache for port 546018e5-13f4-4368-abb5-a0cfa3355314. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:20:25 user nova-compute[75293]: DEBUG nova.network.neutron [req-e96cb5cf-37a0-41a2-82b8-1c2ed4c3b06a req-8b71d844-a44e-4636-a99d-2ea6efca6bab service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Updating instance_info_cache with network_info: [{"id": "546018e5-13f4-4368-abb5-a0cfa3355314", "address": "fa:16:3e:c9:32:7a", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546018e5-13", "ovs_interfaceid": "546018e5-13f4-4368-abb5-a0cfa3355314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:20:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e96cb5cf-37a0-41a2-82b8-1c2ed4c3b06a req-8b71d844-a44e-4636-a99d-2ea6efca6bab service nova] Releasing lock "refresh_cache-ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:20:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-a3302f3c-be8d-4856-9328-3f56fe88c76e req-4c7dd195-2f88-4645-a7b8-2c6e40750879 service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Received event network-vif-plugged-546018e5-13f4-4368-abb5-a0cfa3355314 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:20:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a3302f3c-be8d-4856-9328-3f56fe88c76e req-4c7dd195-2f88-4645-a7b8-2c6e40750879 service nova] Acquiring lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a3302f3c-be8d-4856-9328-3f56fe88c76e req-4c7dd195-2f88-4645-a7b8-2c6e40750879 service nova] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a3302f3c-be8d-4856-9328-3f56fe88c76e req-4c7dd195-2f88-4645-a7b8-2c6e40750879 service nova] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-a3302f3c-be8d-4856-9328-3f56fe88c76e req-4c7dd195-2f88-4645-a7b8-2c6e40750879 service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] No waiting events found dispatching network-vif-plugged-546018e5-13f4-4368-abb5-a0cfa3355314 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:20:26 user nova-compute[75293]: WARNING nova.compute.manager [req-a3302f3c-be8d-4856-9328-3f56fe88c76e req-4c7dd195-2f88-4645-a7b8-2c6e40750879 service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Received unexpected event network-vif-plugged-546018e5-13f4-4368-abb5-a0cfa3355314 for instance with vm_state building and task_state spawning.
Nov 30 07:20:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:27 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4be43bb1-b17c-40b9-953a-c820f2396176 is timed out.
Nov 30 07:20:27 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Successfully detached device vdb from instance 4be43bb1-b17c-40b9-953a-c820f2396176 from the live domain config.
Nov 30 07:20:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PQrijLIS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:20:27 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:20:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[942a0a32-c66a-4a80-bada-59e29957c854]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:20:27 user nova-compute[75293]: No targets found.
Nov 30 07:20:27 user nova-compute[75293]: iSNS:
Nov 30 07:20:27 user nova-compute[75293]: No targets found.
Nov 30 07:20:27 user nova-compute[75293]: STATIC:
Nov 30 07:20:27 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0
Nov 30 07:20:27 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:20:27 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:20:27 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:20:27 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:20:27 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:20:27 user nova-compute[75293]: FIRMWARE:
Nov 30 07:20:27 user nova-compute[75293]: No targets found.
Nov 30 07:20:27 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:20:27 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:20:27 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8e84c5-5ba6-43e1-a481-2d027c043bb4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[da35676a-6337-4335-abf1-2b2fda846909]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:20:27 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:20:27 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:20:27 user nova-compute[75293]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 (non-flash)
Nov 30 07:20:27 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe81b0160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0'): ({'sdc'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Removing single pathed devices sdc {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b316c6bf-857d-4113-9415-e6c82f8815c3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6b1f59-0b97-493c-bce3-45f4076f1bcf]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Flushing IO for device /dev/sdc {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fecf61-4448-4be5-b908-7aea5cebd236]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc564daa-db7e-42ee-b9bb-f1e305829597]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[168881a6-0ea4-4afd-a5f1-b0a30ab39796]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[921e4e24-983e-48e0-8ce1-24b9b561a993]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0, portal: 172.16.0.220,3260]
Nov 30 07:20:28 user nova-compute[75293]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0, portal: 172.16.0.220,3260] successful.
Nov 30 07:20:28 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d3c5c3d-6a81-4796-b0a0-2c641fa87ec0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3c7b34-5d2e-4878-bb5f-91f5d51896bc]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] <== disconnect_volume: return (304ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:20:28 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Instance spawned successfully.
Nov 30 07:20:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG nova.compute.manager [req-d7b510b3-38d3-40ae-95d9-2f36f9b89ba7 req-6da2ab4b-c794-481b-8457-0955816fef1e service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Received event network-vif-plugged-546018e5-13f4-4368-abb5-a0cfa3355314 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d7b510b3-38d3-40ae-95d9-2f36f9b89ba7 req-6da2ab4b-c794-481b-8457-0955816fef1e service nova] Acquiring lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d7b510b3-38d3-40ae-95d9-2f36f9b89ba7 req-6da2ab4b-c794-481b-8457-0955816fef1e service nova] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d7b510b3-38d3-40ae-95d9-2f36f9b89ba7 req-6da2ab4b-c794-481b-8457-0955816fef1e service nova] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:28 user nova-compute[75293]: DEBUG nova.compute.manager [req-d7b510b3-38d3-40ae-95d9-2f36f9b89ba7 req-6da2ab4b-c794-481b-8457-0955816fef1e service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] No waiting events found dispatching network-vif-plugged-546018e5-13f4-4368-abb5-a0cfa3355314 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:20:28 user nova-compute[75293]: WARNING nova.compute.manager [req-d7b510b3-38d3-40ae-95d9-2f36f9b89ba7 req-6da2ab4b-c794-481b-8457-0955816fef1e service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Received unexpected event network-vif-plugged-546018e5-13f4-4368-abb5-a0cfa3355314 for instance with vm_state building and task_state spawning.
Nov 30 07:20:28 user nova-compute[75293]: INFO nova.compute.manager [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 30 07:20:28 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:20:28 user nova-compute[75293]: INFO nova.compute.manager [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Took 6.43 seconds to build instance.
Nov 30 07:20:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8461e078-f98f-4233-a0e7-43205a0de437 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.548s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:29 user nova-compute[75293]: DEBUG nova.objects.instance [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lazy-loading 'flavor' on Instance uuid 4be43bb1-b17c-40b9-953a-c820f2396176 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:20:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-040ea77b-4de7-45d4-9c6f-d12a6424c6e0 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "4be43bb1-b17c-40b9-953a-c820f2396176" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.807s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:31 user nova-compute[75293]: DEBUG nova.compute.manager [req-9ac6b9d1-4387-457f-b665-d9fc800c4093 req-1bb1de08-d8ed-4b7f-b76b-a24feccbf254 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Received event network-changed-dae8d2c1-7bef-420e-b14b-911f6552261b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:20:31 user nova-compute[75293]: DEBUG nova.compute.manager [req-9ac6b9d1-4387-457f-b665-d9fc800c4093 req-1bb1de08-d8ed-4b7f-b76b-a24feccbf254 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Refreshing instance network info cache due to event network-changed-dae8d2c1-7bef-420e-b14b-911f6552261b. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:20:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9ac6b9d1-4387-457f-b665-d9fc800c4093 req-1bb1de08-d8ed-4b7f-b76b-a24feccbf254 service nova] Acquiring lock "refresh_cache-04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:20:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9ac6b9d1-4387-457f-b665-d9fc800c4093 req-1bb1de08-d8ed-4b7f-b76b-a24feccbf254 service nova] Acquired lock "refresh_cache-04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:20:31 user nova-compute[75293]: DEBUG nova.network.neutron [req-9ac6b9d1-4387-457f-b665-d9fc800c4093 req-1bb1de08-d8ed-4b7f-b76b-a24feccbf254 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Refreshing network info cache for port dae8d2c1-7bef-420e-b14b-911f6552261b {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:20:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:31 user nova-compute[75293]: INFO nova.compute.manager [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Terminating instance
Nov 30 07:20:31 user nova-compute[75293]: DEBUG nova.compute.manager [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:20:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-3d5df56d-4235-4a2a-a099-edf49c4e1a1f req-21ff9026-fe0d-4190-b12b-0cee8939c751 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Received event network-vif-unplugged-dae8d2c1-7bef-420e-b14b-911f6552261b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3d5df56d-4235-4a2a-a099-edf49c4e1a1f req-21ff9026-fe0d-4190-b12b-0cee8939c751 service nova] Acquiring lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3d5df56d-4235-4a2a-a099-edf49c4e1a1f req-21ff9026-fe0d-4190-b12b-0cee8939c751 service nova] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-3d5df56d-4235-4a2a-a099-edf49c4e1a1f req-21ff9026-fe0d-4190-b12b-0cee8939c751 service nova] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-3d5df56d-4235-4a2a-a099-edf49c4e1a1f req-21ff9026-fe0d-4190-b12b-0cee8939c751 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] No waiting events found dispatching network-vif-unplugged-dae8d2c1-7bef-420e-b14b-911f6552261b {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-3d5df56d-4235-4a2a-a099-edf49c4e1a1f req-21ff9026-fe0d-4190-b12b-0cee8939c751 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Received event network-vif-unplugged-dae8d2c1-7bef-420e-b14b-911f6552261b for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG nova.network.neutron [req-9ac6b9d1-4387-457f-b665-d9fc800c4093 req-1bb1de08-d8ed-4b7f-b76b-a24feccbf254 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Updated VIF entry in instance network info cache for port dae8d2c1-7bef-420e-b14b-911f6552261b. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG nova.network.neutron [req-9ac6b9d1-4387-457f-b665-d9fc800c4093 req-1bb1de08-d8ed-4b7f-b76b-a24feccbf254 service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Updating instance_info_cache with network_info: [{"id": "dae8d2c1-7bef-420e-b14b-911f6552261b", "address": "fa:16:3e:d0:1c:74", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae8d2c1-7b", "ovs_interfaceid": "dae8d2c1-7bef-420e-b14b-911f6552261b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9ac6b9d1-4387-457f-b665-d9fc800c4093 req-1bb1de08-d8ed-4b7f-b76b-a24feccbf254 service nova] Releasing lock "refresh_cache-04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:20:32 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Instance destroyed successfully.
Nov 30 07:20:32 user nova-compute[75293]: DEBUG nova.objects.instance [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lazy-loading 'resources' on Instance uuid 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-194695443',display_name='tempest-TestStampPattern-server-194695443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-194695443',id=30,image_ref='50d27170-e54d-40e0-9d79-31e4ded1fe5d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0qMxl7UVzzNRBhKaK7jCT6r/53GRkB3Di+2AcuMeqPobnGiie2ivpr0tiN4y2/+N5eqEzUQwswDBS+N1ym58HFieIzNbbIOVxlbtYOwXvyj9jGINm6Alzpe31PR/dT3g==',key_name='tempest-TestStampPattern-1639076054',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:17:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3973d2dcb7674ea5b11eb2007f26df78',ramdisk_id='',reservation_id='r-bthdhn49',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d34f99fc-343e-4e8a-83e6-372b0326bded',image_min_disk='1',image_min_ram='0',image_owner_id='3973d2dcb7674ea5b11eb2007f26df78',image_owner_project_name='tempest-TestStampPattern-1058543327',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1058543327-project-member',image_user_id='bec86b562bb54d7c9e10d8ce99723460',owner_project_name='tempest-TestStampPattern-1058543327',owner_user_name='tempest-TestStampPattern-1058543327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:17:44Z,user_data=None,user_id='bec86b562bb54d7c9e10d8ce99723460',uuid=04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dae8d2c1-7bef-420e-b14b-911f6552261b", "address": "fa:16:3e:d0:1c:74", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae8d2c1-7b", "ovs_interfaceid": "dae8d2c1-7bef-420e-b14b-911f6552261b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Converting VIF {"id": "dae8d2c1-7bef-420e-b14b-911f6552261b", "address": "fa:16:3e:d0:1c:74", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae8d2c1-7b", "ovs_interfaceid": "dae8d2c1-7bef-420e-b14b-911f6552261b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=dae8d2c1-7bef-420e-b14b-911f6552261b,network=Network(bab4085c-ab04-4e03-912e-6c6c8fde90b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae8d2c1-7b') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG os_vif [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=dae8d2c1-7bef-420e-b14b-911f6552261b,network=Network(bab4085c-ab04-4e03-912e-6c6c8fde90b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae8d2c1-7b') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdae8d2c1-7b, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5c35965-c236-4173-bbfa-0508b8d78a6f) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:32 user nova-compute[75293]: INFO os_vif [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:1c:74,bridge_name='br-int',has_traffic_filtering=True,id=dae8d2c1-7bef-420e-b14b-911f6552261b,network=Network(bab4085c-ab04-4e03-912e-6c6c8fde90b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae8d2c1-7b')
Nov 30 07:20:32 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Deleting instance files /opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7_del
Nov 30 07:20:32 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Deletion of /opt/stack/data/nova/instances/04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7_del complete
Nov 30 07:20:32 user nova-compute[75293]: INFO nova.compute.manager [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 30 07:20:32 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:20:32 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:20:33 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:20:33 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Took 0.47 seconds to deallocate network for instance.
Nov 30 07:20:33 user nova-compute[75293]: DEBUG nova.compute.manager [req-b7941028-2b60-4ec6-a3fc-1b5c0ec1a5f8 req-3596b177-cc45-41cd-a2d5-3a9c4716f31b service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Received event network-vif-deleted-dae8d2c1-7bef-420e-b14b-911f6552261b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:20:33 user nova-compute[75293]: INFO nova.compute.manager [req-b7941028-2b60-4ec6-a3fc-1b5c0ec1a5f8 req-3596b177-cc45-41cd-a2d5-3a9c4716f31b service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Neutron deleted interface dae8d2c1-7bef-420e-b14b-911f6552261b; detaching it from the instance and deleting it from the info cache
Nov 30 07:20:33 user nova-compute[75293]: DEBUG nova.network.neutron [req-b7941028-2b60-4ec6-a3fc-1b5c0ec1a5f8 req-3596b177-cc45-41cd-a2d5-3a9c4716f31b service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:20:33 user nova-compute[75293]: DEBUG nova.compute.manager [req-b7941028-2b60-4ec6-a3fc-1b5c0ec1a5f8 req-3596b177-cc45-41cd-a2d5-3a9c4716f31b service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Detach interface failed, port_id=dae8d2c1-7bef-420e-b14b-911f6552261b, reason: Instance 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7 could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:20:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:33 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:20:33 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:20:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:33 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Deleted allocations for instance 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7
Nov 30 07:20:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7f264adb-6ea2-4c1e-9f0f-d9fa6d8d3ec1 tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.055s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:34 user nova-compute[75293]: DEBUG nova.compute.manager [req-0700cc0b-d64e-4f52-b08b-9ab27eee254e req-d5ba2f11-c9b3-4ef4-99e8-2187109034fc service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Received event network-vif-plugged-dae8d2c1-7bef-420e-b14b-911f6552261b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:20:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0700cc0b-d64e-4f52-b08b-9ab27eee254e req-d5ba2f11-c9b3-4ef4-99e8-2187109034fc service nova] Acquiring lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0700cc0b-d64e-4f52-b08b-9ab27eee254e req-d5ba2f11-c9b3-4ef4-99e8-2187109034fc service nova] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0700cc0b-d64e-4f52-b08b-9ab27eee254e req-d5ba2f11-c9b3-4ef4-99e8-2187109034fc service nova] Lock "04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:34 user nova-compute[75293]: DEBUG nova.compute.manager [req-0700cc0b-d64e-4f52-b08b-9ab27eee254e req-d5ba2f11-c9b3-4ef4-99e8-2187109034fc service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] No waiting events found dispatching network-vif-plugged-dae8d2c1-7bef-420e-b14b-911f6552261b {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:20:34 user nova-compute[75293]: WARNING nova.compute.manager [req-0700cc0b-d64e-4f52-b08b-9ab27eee254e req-d5ba2f11-c9b3-4ef4-99e8-2187109034fc service nova] [instance: 04d53b4b-1ed9-4f5e-9c86-5a22a4242cb7] Received unexpected event network-vif-plugged-dae8d2c1-7bef-420e-b14b-911f6552261b for instance with vm_state deleted and task_state None.
Nov 30 07:20:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "1b7deb0a-39af-4d93-b93d-5765a731f702" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "1b7deb0a-39af-4d93-b93d-5765a731f702" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "1b7deb0a-39af-4d93-b93d-5765a731f702-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "1b7deb0a-39af-4d93-b93d-5765a731f702-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "1b7deb0a-39af-4d93-b93d-5765a731f702-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:35 user nova-compute[75293]: INFO nova.compute.manager [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Terminating instance
Nov 30 07:20:35 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:20:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:35 user nova-compute[75293]: DEBUG nova.compute.manager [req-e02e20ea-3279-4e2a-a06f-4fae6a273a04 req-bfad5d31-7936-4334-8ca1-08a3f69a87fa service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Received event network-vif-unplugged-26f5514b-9205-4e17-9d2b-2196aaa085d2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:20:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e02e20ea-3279-4e2a-a06f-4fae6a273a04 req-bfad5d31-7936-4334-8ca1-08a3f69a87fa service nova] Acquiring lock "1b7deb0a-39af-4d93-b93d-5765a731f702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e02e20ea-3279-4e2a-a06f-4fae6a273a04 req-bfad5d31-7936-4334-8ca1-08a3f69a87fa service nova] Lock "1b7deb0a-39af-4d93-b93d-5765a731f702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e02e20ea-3279-4e2a-a06f-4fae6a273a04 req-bfad5d31-7936-4334-8ca1-08a3f69a87fa service nova] Lock "1b7deb0a-39af-4d93-b93d-5765a731f702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:35 user nova-compute[75293]: DEBUG nova.compute.manager [req-e02e20ea-3279-4e2a-a06f-4fae6a273a04 req-bfad5d31-7936-4334-8ca1-08a3f69a87fa service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] No waiting events found dispatching network-vif-unplugged-26f5514b-9205-4e17-9d2b-2196aaa085d2 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:20:35 user nova-compute[75293]: DEBUG nova.compute.manager [req-e02e20ea-3279-4e2a-a06f-4fae6a273a04 req-bfad5d31-7936-4334-8ca1-08a3f69a87fa service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Received event network-vif-unplugged-26f5514b-9205-4e17-9d2b-2196aaa085d2 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:20:36 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Instance destroyed successfully.
Nov 30 07:20:36 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lazy-loading 'resources' on Instance uuid 1b7deb0a-39af-4d93-b93d-5765a731f702 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:20:36 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-783117087',display_name='tempest-ServerActionsTestOtherA-server-783117087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-783117087',id=2,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInXIkcLXsgicVrKBV1FJ4eUk9bqleLqUW+Rfq2hagWXh0lWDRkNj3X54YFexKmG2fABDJgaloeZ046QUW/gM3BPiB1qacS7UzihRugfjl4tEjpyq1iC1dsqauDTmCgB5Q==',key_name='tempest-keypair-417038146',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:07:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7d94d0308eb444dbdcd3e5c7c21fe79',ramdisk_id='',reservation_id='r-68k12gsn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1263829597',owner_user_name='tempest-ServerActionsTestOtherA-1263829597-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:07:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='917adc7b254e4711ad5f5adbdd2689d4',uuid=1b7deb0a-39af-4d93-b93d-5765a731f702,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "address": "fa:16:3e:bb:63:ac", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f5514b-92", "ovs_interfaceid": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:20:36 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converting VIF {"id": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "address": "fa:16:3e:bb:63:ac", "network": {"id": "f5269d26-2a38-46d5-8732-8203c82a127e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2029711665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d94d0308eb444dbdcd3e5c7c21fe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26f5514b-92", "ovs_interfaceid": "26f5514b-9205-4e17-9d2b-2196aaa085d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:20:36 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:63:ac,bridge_name='br-int',has_traffic_filtering=True,id=26f5514b-9205-4e17-9d2b-2196aaa085d2,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f5514b-92') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:20:36 user nova-compute[75293]: DEBUG os_vif [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:63:ac,bridge_name='br-int',has_traffic_filtering=True,id=26f5514b-9205-4e17-9d2b-2196aaa085d2,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f5514b-92') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:20:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26f5514b-92, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:20:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0bc86a7a-4487-423c-bab5-62a0d7879673) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:20:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:20:36 user nova-compute[75293]: INFO os_vif [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:63:ac,bridge_name='br-int',has_traffic_filtering=True,id=26f5514b-9205-4e17-9d2b-2196aaa085d2,network=Network(f5269d26-2a38-46d5-8732-8203c82a127e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26f5514b-92')
Nov 30 07:20:36 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Deleting instance files /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702_del
Nov 30 07:20:36 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Deletion of /opt/stack/data/nova/instances/1b7deb0a-39af-4d93-b93d-5765a731f702_del complete
Nov 30 07:20:36 user nova-compute[75293]: INFO nova.compute.manager [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 30 07:20:36 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:20:36 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:20:36 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:20:37 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:20:37 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Took 0.84 seconds to deallocate network for instance.
Nov 30 07:20:37 user nova-compute[75293]: DEBUG nova.compute.manager [req-7ce63d11-3bc1-4e4c-ae41-d1072fa74a1d req-f7295b1f-20e1-4fcc-a7d3-444a00211787 service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Received event network-vif-deleted-26f5514b-9205-4e17-9d2b-2196aaa085d2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:20:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:37 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:20:37 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:20:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:37 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Deleted allocations for instance 1b7deb0a-39af-4d93-b93d-5765a731f702
Nov 30 07:20:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8187600b-69ff-481a-858c-4a2733910e6a tempest-ServerActionsTestOtherA-1263829597 tempest-ServerActionsTestOtherA-1263829597-project-member] Lock "1b7deb0a-39af-4d93-b93d-5765a731f702" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.004s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:37 user nova-compute[75293]: DEBUG nova.compute.manager [req-415c7d7c-c30f-4a0e-97cf-246f050aa334 req-a9b25b4b-ca22-46f8-afc4-f0dcf305be3a service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Received event network-vif-plugged-26f5514b-9205-4e17-9d2b-2196aaa085d2 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:20:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-415c7d7c-c30f-4a0e-97cf-246f050aa334 req-a9b25b4b-ca22-46f8-afc4-f0dcf305be3a service nova] Acquiring lock "1b7deb0a-39af-4d93-b93d-5765a731f702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-415c7d7c-c30f-4a0e-97cf-246f050aa334 req-a9b25b4b-ca22-46f8-afc4-f0dcf305be3a service nova] Lock "1b7deb0a-39af-4d93-b93d-5765a731f702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-415c7d7c-c30f-4a0e-97cf-246f050aa334 req-a9b25b4b-ca22-46f8-afc4-f0dcf305be3a service nova] Lock "1b7deb0a-39af-4d93-b93d-5765a731f702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:37 user nova-compute[75293]: DEBUG nova.compute.manager [req-415c7d7c-c30f-4a0e-97cf-246f050aa334 req-a9b25b4b-ca22-46f8-afc4-f0dcf305be3a service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] No waiting events found dispatching network-vif-plugged-26f5514b-9205-4e17-9d2b-2196aaa085d2 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:20:37 user nova-compute[75293]: WARNING nova.compute.manager [req-415c7d7c-c30f-4a0e-97cf-246f050aa334 req-a9b25b4b-ca22-46f8-afc4-f0dcf305be3a service nova] [instance: 1b7deb0a-39af-4d93-b93d-5765a731f702] Received unexpected event network-vif-plugged-26f5514b-9205-4e17-9d2b-2196aaa085d2 for instance with vm_state deleted and task_state None.
Nov 30 07:20:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:46 user nova-compute[75293]: DEBUG nova.compute.manager [req-e823b11d-0970-4a90-acd1-4ad3a7e965e9 req-f1acf131-69de-4be0-b1cd-bf5539c52955 service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Received event network-changed-ea487809-e5c3-435b-be3e-f59400b4d9cd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:20:46 user nova-compute[75293]: DEBUG nova.compute.manager [req-e823b11d-0970-4a90-acd1-4ad3a7e965e9 req-f1acf131-69de-4be0-b1cd-bf5539c52955 service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Refreshing instance network info cache due to event network-changed-ea487809-e5c3-435b-be3e-f59400b4d9cd. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:20:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e823b11d-0970-4a90-acd1-4ad3a7e965e9 req-f1acf131-69de-4be0-b1cd-bf5539c52955 service nova] Acquiring lock "refresh_cache-4ebf0be9-15e0-418c-a554-7885c79a725b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:20:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e823b11d-0970-4a90-acd1-4ad3a7e965e9 req-f1acf131-69de-4be0-b1cd-bf5539c52955 service nova] Acquired lock "refresh_cache-4ebf0be9-15e0-418c-a554-7885c79a725b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:20:46 user nova-compute[75293]: DEBUG nova.network.neutron [req-e823b11d-0970-4a90-acd1-4ad3a7e965e9 req-f1acf131-69de-4be0-b1cd-bf5539c52955 service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Refreshing network info cache for port ea487809-e5c3-435b-be3e-f59400b4d9cd {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:20:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:46 user nova-compute[75293]: DEBUG nova.network.neutron [req-e823b11d-0970-4a90-acd1-4ad3a7e965e9 req-f1acf131-69de-4be0-b1cd-bf5539c52955 service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Updated VIF entry in instance network info cache for port ea487809-e5c3-435b-be3e-f59400b4d9cd. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:20:46 user nova-compute[75293]: DEBUG nova.network.neutron [req-e823b11d-0970-4a90-acd1-4ad3a7e965e9 req-f1acf131-69de-4be0-b1cd-bf5539c52955 service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Updating instance_info_cache with network_info: [{"id": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "address": "fa:16:3e:61:ea:d9", "network": {"id": "f5788c0d-7b19-4bf5-8197-f7a852630bd6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1462636557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9623b2e7295481597a1c6e925ed5d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea487809-e5", "ovs_interfaceid": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:20:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e823b11d-0970-4a90-acd1-4ad3a7e965e9 req-f1acf131-69de-4be0-b1cd-bf5539c52955 service nova] Releasing lock "refresh_cache-4ebf0be9-15e0-418c-a554-7885c79a725b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:20:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:49 user nova-compute[75293]: DEBUG nova.objects.instance [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lazy-loading 'flavor' on Instance uuid 4ebf0be9-15e0-418c-a554-7885c79a725b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:20:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:49 user nova-compute[75293]: INFO nova.compute.manager [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Attaching volume bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 to /dev/vdb
Nov 30 07:20:50 user nova-compute[75293]: DEBUG os_brick.utils [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11ec6e0-4499-4083-a124-7f2831c23cc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2087ad7d-10bd-4cf6-ae8d-1d23d1b783b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c06bf79-c1d7-4729-bf8f-8af73dbc405c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cde3807-6796-4f5f-a298-4371aec55a20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:20:50 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:20:50 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4c0382-6b8e-4667-819b-55f24ccfd24e]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG os_brick.utils [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:20:50 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Updating existing volume attachment record: ed497e62-ff34-4189-a99e-aed7dd1dfbee {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:20:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:54 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:20:54 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:20:54 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:20:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:20:56 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:20:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-4be43bb1-b17c-40b9-953a-c820f2396176" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:20:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-4be43bb1-b17c-40b9-953a-c820f2396176" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:20:56 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Updating instance_info_cache with network_info: [{"id": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "address": "fa:16:3e:09:2f:cb", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10da91-4b", "ovs_interfaceid": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-4be43bb1-b17c-40b9-953a-c820f2396176" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "4be43bb1-b17c-40b9-953a-c820f2396176" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "4be43bb1-b17c-40b9-953a-c820f2396176" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "4be43bb1-b17c-40b9-953a-c820f2396176-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "4be43bb1-b17c-40b9-953a-c820f2396176-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "4be43bb1-b17c-40b9-953a-c820f2396176-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:57 user nova-compute[75293]: INFO nova.compute.manager [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Terminating instance
Nov 30 07:20:57 user nova-compute[75293]: DEBUG nova.compute.manager [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG nova.compute.manager [req-251b603f-d705-41fb-ae13-1d6f00de3f0c req-b623ac7a-4868-4e07-8d62-9652c7e04c22 service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Received event network-vif-unplugged-3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-251b603f-d705-41fb-ae13-1d6f00de3f0c req-b623ac7a-4868-4e07-8d62-9652c7e04c22 service nova] Acquiring lock "4be43bb1-b17c-40b9-953a-c820f2396176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-251b603f-d705-41fb-ae13-1d6f00de3f0c req-b623ac7a-4868-4e07-8d62-9652c7e04c22 service nova] Lock "4be43bb1-b17c-40b9-953a-c820f2396176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-251b603f-d705-41fb-ae13-1d6f00de3f0c req-b623ac7a-4868-4e07-8d62-9652c7e04c22 service nova] Lock "4be43bb1-b17c-40b9-953a-c820f2396176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG nova.compute.manager [req-251b603f-d705-41fb-ae13-1d6f00de3f0c req-b623ac7a-4868-4e07-8d62-9652c7e04c22 service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] No waiting events found dispatching network-vif-unplugged-3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG nova.compute.manager [req-251b603f-d705-41fb-ae13-1d6f00de3f0c req-b623ac7a-4868-4e07-8d62-9652c7e04c22 service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Received event network-vif-unplugged-3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVXbqNjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:20:58 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.009s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:20:58 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:20:58 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[299b403a-70d7-4084-be15-a559b1cfed10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:20:58 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f160349-1959-423e-9fa8-b1eaea764b44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805] added
Nov 30 07:20:58 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[131da111-a2c8-42ac-9eb9-204ed3f73747]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d65dbd-38bd-46ea-8e32-704e3b30b437]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MVXbqNjD {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MVXbqNjD" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8de49d7-f3f6-438b-bf72-a6dfe162b675]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MVXbqNjD'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c5e391-2d86-4562-9af7-e8c18c3cdee9]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4381940-9099-4826-9005-7ef5a86bad1f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:20:58 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:20:58 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7a7e28-3bc7-4620-baf6-2e5a8c1b54fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805, portal: 172.16.0.220,3260]
Nov 30 07:20:58 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805, portal: 172.16.0.220,3260] successful.
Nov 30 07:20:58 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:58 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Instance destroyed successfully.
Nov 30 07:20:58 user nova-compute[75293]: DEBUG nova.objects.instance [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lazy-loading 'resources' on Instance uuid 4be43bb1-b17c-40b9-953a-c820f2396176 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab0f269-29e6-4982-9488-542fd326a1ce]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1748796169',display_name='tempest-AttachVolumeNegativeTest-server-1748796169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1748796169',id=23,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjfec5PvW0Fp+MpU4gl0VZp6BjC3rHYkV0mSB12dv0FUDuwAqumheUSJGBCvYzMOld6p5oCb7SG8nFmC2LBatm1iUEQczWEQh95A57kj60vwFJEb2aX5jdwbickuyZP7w==',key_name='tempest-keypair-1131404555',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:15:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68ff34b2e2c047319c1fe166c5029790',ramdisk_id='',reservation_id='r-r8o6zt77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1915468397',owner_user_name='tempest-AttachVolumeNegativeTest-1915468397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:15:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe34a1b2c38472d831ae5d7afa85c77',uuid=4be43bb1-b17c-40b9-953a-c820f2396176,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "address": "fa:16:3e:09:2f:cb", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10da91-4b", "ovs_interfaceid": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converting VIF {"id": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "address": "fa:16:3e:09:2f:cb", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10da91-4b", "ovs_interfaceid": "3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:2f:cb,bridge_name='br-int',has_traffic_filtering=True,id=3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f10da91-4b') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_vif [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:2f:cb,bridge_name='br-int',has_traffic_filtering=True,id=3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f10da91-4b') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd455c5d-a11c-4eea-a31a-1244ed6e7e41]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:20:58 user nova-compute[75293]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 (non-flash)
Nov 30 07:20:58 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:20:58 user nova-compute[75293]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 (non-flash)
Nov 30 07:20:58 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f10da91-4b, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4cc5b09c-852a-45de-b886-a062155f024f) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:20:58 user nova-compute[75293]: INFO os_vif [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:2f:cb,bridge_name='br-int',has_traffic_filtering=True,id=3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f10da91-4b')
Nov 30 07:20:58 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Deleting instance files /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176_del
Nov 30 07:20:58 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Deletion of /opt/stack/data/nova/instances/4be43bb1-b17c-40b9-953a-c820f2396176_del complete
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7a7e21-ac95-4e7b-acf0-549e85bd923d]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVXbqNjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:58 user nova-compute[75293]: INFO nova.compute.manager [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 30 07:20:59 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:20:59 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:20:59 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:20:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:20:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:20:59 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Error from libvirt while getting description of instance-00000017: [Error Code 42] Domain not found: no domain with matching uuid '4be43bb1-b17c-40b9-953a-c820f2396176' (instance-00000017): libvirt.libvirtError: Domain not found: no domain with matching uuid '4be43bb1-b17c-40b9-953a-c820f2396176' (instance-00000017)
Nov 30 07:21:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.781s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] <== connect_volume: return (1790ms) {'type': 'block', 'scsi_wwn': '23031646662663831', 'path': '/dev/sdb'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031646662663831', 'path': '/dev/sdb'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-a1a14faf-44ee-44da-8f4f-3153fc3daab5 req-989bda08-1056-447c-bd65-2e7d0b9cda8a service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Received event network-vif-deleted-3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:21:00 user nova-compute[75293]: INFO nova.compute.manager [req-a1a14faf-44ee-44da-8f4f-3153fc3daab5 req-989bda08-1056-447c-bd65-2e7d0b9cda8a service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Neutron deleted interface 3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4; detaching it from the instance and deleting it from the info cache
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.network.neutron [req-a1a14faf-44ee-44da-8f4f-3153fc3daab5 req-989bda08-1056-447c-bd65-2e7d0b9cda8a service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:21:00 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:21:00 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=8046MB free_disk=24.96249008178711GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:00 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Took 1.23 seconds to deallocate network for instance.
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.objects.instance [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lazy-loading 'flavor' on Instance uuid 4ebf0be9-15e0-418c-a554-7885c79a725b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-a1a14faf-44ee-44da-8f4f-3153fc3daab5 req-989bda08-1056-447c-bd65-2e7d0b9cda8a service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Detach interface failed, port_id=3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4, reason: Instance 4be43bb1-b17c-40b9-953a-c820f2396176 could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:21:00 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:21:00 user nova-compute[75293]:   <source dev="/dev/sdb"/>
Nov 30 07:21:00 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:21:00 user nova-compute[75293]:   <serial>bdd84a2f-6e8d-4cd1-91a3-dcbcae822805</serial>
Nov 30 07:21:00 user nova-compute[75293]: </disk>
Nov 30 07:21:00 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance c8d1df78-2aa2-4710-a570-5f72c60cfc26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance d34f99fc-343e-4e8a-83e6-372b0326bded actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 4be43bb1-b17c-40b9-953a-c820f2396176 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance ed037c80-4f33-4e03-907c-18b4ea122411 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 4ebf0be9-15e0-418c-a554-7885c79a725b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-b7e84e07-cda9-46b5-adff-18a86015e27f req-3fbec513-75e2-4175-9da7-44418cbed1d6 service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Received event network-vif-plugged-3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b7e84e07-cda9-46b5-adff-18a86015e27f req-3fbec513-75e2-4175-9da7-44418cbed1d6 service nova] Acquiring lock "4be43bb1-b17c-40b9-953a-c820f2396176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b7e84e07-cda9-46b5-adff-18a86015e27f req-3fbec513-75e2-4175-9da7-44418cbed1d6 service nova] Lock "4be43bb1-b17c-40b9-953a-c820f2396176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b7e84e07-cda9-46b5-adff-18a86015e27f req-3fbec513-75e2-4175-9da7-44418cbed1d6 service nova] Lock "4be43bb1-b17c-40b9-953a-c820f2396176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.compute.manager [req-b7e84e07-cda9-46b5-adff-18a86015e27f req-3fbec513-75e2-4175-9da7-44418cbed1d6 service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] No waiting events found dispatching network-vif-plugged-3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:21:00 user nova-compute[75293]: WARNING nova.compute.manager [req-b7e84e07-cda9-46b5-adff-18a86015e27f req-3fbec513-75e2-4175-9da7-44418cbed1d6 service nova] [instance: 4be43bb1-b17c-40b9-953a-c820f2396176] Received unexpected event network-vif-plugged-3f10da91-4ba0-4fb8-b1d7-7b7cb7291da4 for instance with vm_state deleted and task_state None.
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.430s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.368s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] No VIF found with MAC fa:16:3e:61:ea:d9, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-da714596-9be2-4e9d-9921-4b3afec2a3d3 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.926s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:21:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:01 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Deleted allocations for instance 4be43bb1-b17c-40b9-953a-c820f2396176
Nov 30 07:21:01 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:21:01 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:21:01 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:21:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-91452425-6430-4c37-889e-d1496b38b872 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "4be43bb1-b17c-40b9-953a-c820f2396176" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.276s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:01 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:21:01 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:21:01 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:21:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:02 user nova-compute[75293]: DEBUG nova.compute.manager [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:21:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:02 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:21:02 user nova-compute[75293]: INFO nova.compute.claims [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Claim successful on node user
Nov 30 07:21:02 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:21:02 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:21:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:02 user nova-compute[75293]: DEBUG nova.compute.manager [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:21:02 user nova-compute[75293]: DEBUG nova.compute.manager [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:21:02 user nova-compute[75293]: DEBUG nova.network.neutron [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:21:02 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:21:02 user nova-compute[75293]: DEBUG nova.compute.manager [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:21:02 user nova-compute[75293]: DEBUG nova.policy [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83119c1bbe4142a086680a113403018c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09e4044dadb4f2aa0d29f35f23008d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:21:02 user nova-compute[75293]: DEBUG nova.compute.manager [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:21:02 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:21:02 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Creating image(s)
Nov 30 07:21:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "/opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "/opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "/opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.185s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.205s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk 1073741824" returned: 0 in 0.116s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG nova.network.neutron [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Successfully created port: 13a453d0-49aa-49ed-8032-18101893f071 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.209s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Cannot resize image /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Ensure instance console log exists: /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.network.neutron [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Successfully updated port: 13a453d0-49aa-49ed-8032-18101893f071 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "refresh_cache-54c60b45-04dc-4d3b-96ec-c2d0f583cafa" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquired lock "refresh_cache-54c60b45-04dc-4d3b-96ec-c2d0f583cafa" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.network.neutron [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-d71d6e51-1cb5-4cc2-a89e-946ec5bc38f6 req-ef42576f-d1fd-4023-a6c2-45096961e035 service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Received event network-changed-13a453d0-49aa-49ed-8032-18101893f071 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.compute.manager [req-d71d6e51-1cb5-4cc2-a89e-946ec5bc38f6 req-ef42576f-d1fd-4023-a6c2-45096961e035 service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Refreshing instance network info cache due to event network-changed-13a453d0-49aa-49ed-8032-18101893f071. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d71d6e51-1cb5-4cc2-a89e-946ec5bc38f6 req-ef42576f-d1fd-4023-a6c2-45096961e035 service nova] Acquiring lock "refresh_cache-54c60b45-04dc-4d3b-96ec-c2d0f583cafa" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.network.neutron [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.network.neutron [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Updating instance_info_cache with network_info: [{"id": "13a453d0-49aa-49ed-8032-18101893f071", "address": "fa:16:3e:59:47:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a453d0-49", "ovs_interfaceid": "13a453d0-49aa-49ed-8032-18101893f071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Releasing lock "refresh_cache-54c60b45-04dc-4d3b-96ec-c2d0f583cafa" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.compute.manager [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Instance network_info: |[{"id": "13a453d0-49aa-49ed-8032-18101893f071", "address": "fa:16:3e:59:47:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a453d0-49", "ovs_interfaceid": "13a453d0-49aa-49ed-8032-18101893f071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d71d6e51-1cb5-4cc2-a89e-946ec5bc38f6 req-ef42576f-d1fd-4023-a6c2-45096961e035 service nova] Acquired lock "refresh_cache-54c60b45-04dc-4d3b-96ec-c2d0f583cafa" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.network.neutron [req-d71d6e51-1cb5-4cc2-a89e-946ec5bc38f6 req-ef42576f-d1fd-4023-a6c2-45096961e035 service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Refreshing network info cache for port 13a453d0-49aa-49ed-8032-18101893f071 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Start _get_guest_xml network_info=[{"id": "13a453d0-49aa-49ed-8032-18101893f071", "address": "fa:16:3e:59:47:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a453d0-49", "ovs_interfaceid": "13a453d0-49aa-49ed-8032-18101893f071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:21:04 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:21:04 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:21:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1391852437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1391852437',id=34,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09e4044dadb4f2aa0d29f35f23008d2',ramdisk_id='',reservation_id='r-eltdo623',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:21:03Z,user_data=None,user_id='83119c1bbe4142a086680a113403018c',uuid=54c60b45-04dc-4d3b-96ec-c2d0f583cafa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13a453d0-49aa-49ed-8032-18101893f071", "address": "fa:16:3e:59:47:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a453d0-49", "ovs_interfaceid": "13a453d0-49aa-49ed-8032-18101893f071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converting VIF {"id": "13a453d0-49aa-49ed-8032-18101893f071", "address": "fa:16:3e:59:47:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a453d0-49", "ovs_interfaceid": "13a453d0-49aa-49ed-8032-18101893f071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:47:51,bridge_name='br-int',has_traffic_filtering=True,id=13a453d0-49aa-49ed-8032-18101893f071,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13a453d0-49') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.objects.instance [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'pci_devices' on Instance uuid 54c60b45-04dc-4d3b-96ec-c2d0f583cafa {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:21:04 user nova-compute[75293]:   <uuid>54c60b45-04dc-4d3b-96ec-c2d0f583cafa</uuid>
Nov 30 07:21:04 user nova-compute[75293]:   <name>instance-00000022</name>
Nov 30 07:21:04 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:21:04 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:21:04 user nova-compute[75293]:   <metadata>
Nov 30 07:21:04 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:21:04 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:21:04 user nova-compute[75293]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1391852437</nova:name>
Nov 30 07:21:04 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:21:04</nova:creationTime>
Nov 30 07:21:04 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:21:04 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:21:04 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:21:04 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:21:04 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:21:04 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:21:04 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:21:04 user nova-compute[75293]:       <nova:owner>
Nov 30 07:21:04 user nova-compute[75293]:         <nova:user uuid="83119c1bbe4142a086680a113403018c">tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member</nova:user>
Nov 30 07:21:04 user nova-compute[75293]:         <nova:project uuid="f09e4044dadb4f2aa0d29f35f23008d2">tempest-ServerBootFromVolumeStableRescueTest-2053873633</nova:project>
Nov 30 07:21:04 user nova-compute[75293]:       </nova:owner>
Nov 30 07:21:04 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:21:04 user nova-compute[75293]:       <nova:ports>
Nov 30 07:21:04 user nova-compute[75293]:         <nova:port uuid="13a453d0-49aa-49ed-8032-18101893f071">
Nov 30 07:21:04 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 07:21:04 user nova-compute[75293]:         </nova:port>
Nov 30 07:21:04 user nova-compute[75293]:       </nova:ports>
Nov 30 07:21:04 user nova-compute[75293]:     </nova:instance>
Nov 30 07:21:04 user nova-compute[75293]:   </metadata>
Nov 30 07:21:04 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:21:04 user nova-compute[75293]:     <system>
Nov 30 07:21:04 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:21:04 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:21:04 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:21:04 user nova-compute[75293]:       <entry name="serial">54c60b45-04dc-4d3b-96ec-c2d0f583cafa</entry>
Nov 30 07:21:04 user nova-compute[75293]:       <entry name="uuid">54c60b45-04dc-4d3b-96ec-c2d0f583cafa</entry>
Nov 30 07:21:04 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:21:04 user nova-compute[75293]:     </system>
Nov 30 07:21:04 user nova-compute[75293]:   </sysinfo>
Nov 30 07:21:04 user nova-compute[75293]:   <os>
Nov 30 07:21:04 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:21:04 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:21:04 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:21:04 user nova-compute[75293]:   </os>
Nov 30 07:21:04 user nova-compute[75293]:   <features>
Nov 30 07:21:04 user nova-compute[75293]:     <acpi/>
Nov 30 07:21:04 user nova-compute[75293]:     <apic/>
Nov 30 07:21:04 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:21:04 user nova-compute[75293]:   </features>
Nov 30 07:21:04 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:21:04 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:21:04 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:21:04 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:21:04 user nova-compute[75293]:   </clock>
Nov 30 07:21:04 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:21:04 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:21:04 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:21:04 user nova-compute[75293]:   </cpu>
Nov 30 07:21:04 user nova-compute[75293]:   <devices>
Nov 30 07:21:04 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:21:04 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:21:04 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk"/>
Nov 30 07:21:04 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:21:04 user nova-compute[75293]:     </disk>
Nov 30 07:21:04 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:21:04 user nova-compute[75293]:       <mac address="fa:16:3e:59:47:51"/>
Nov 30 07:21:04 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:21:04 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:21:04 user nova-compute[75293]:       <target dev="tap13a453d0-49"/>
Nov 30 07:21:04 user nova-compute[75293]:     </interface>
Nov 30 07:21:04 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:21:04 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/console.log" append="off"/>
Nov 30 07:21:04 user nova-compute[75293]:     </serial>
Nov 30 07:21:04 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:21:04 user nova-compute[75293]:     <video>
Nov 30 07:21:04 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:21:04 user nova-compute[75293]:     </video>
Nov 30 07:21:04 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:21:04 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:21:04 user nova-compute[75293]:     </rng>
Nov 30 07:21:04 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:21:04 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:21:04 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:21:04 user nova-compute[75293]:     </memballoon>
Nov 30 07:21:04 user nova-compute[75293]:   </devices>
Nov 30 07:21:04 user nova-compute[75293]: </domain>
Nov 30 07:21:04 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:21:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1391852437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1391852437',id=34,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09e4044dadb4f2aa0d29f35f23008d2',ramdisk_id='',reservation_id='r-eltdo623',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:21:03Z,user_data=None,user_id='83119c1bbe4142a086680a113403018c',uuid=54c60b45-04dc-4d3b-96ec-c2d0f583cafa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13a453d0-49aa-49ed-8032-18101893f071", "address": "fa:16:3e:59:47:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a453d0-49", "ovs_interfaceid": "13a453d0-49aa-49ed-8032-18101893f071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converting VIF {"id": "13a453d0-49aa-49ed-8032-18101893f071", "address": "fa:16:3e:59:47:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a453d0-49", "ovs_interfaceid": "13a453d0-49aa-49ed-8032-18101893f071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:47:51,bridge_name='br-int',has_traffic_filtering=True,id=13a453d0-49aa-49ed-8032-18101893f071,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13a453d0-49') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG os_vif [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:47:51,bridge_name='br-int',has_traffic_filtering=True,id=13a453d0-49aa-49ed-8032-18101893f071,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13a453d0-49') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afb7687b-53f8-5358-b484-24cd3acd2401', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13a453d0-49, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13a453d0-49, col_values=(('qos', UUID('3b8b98f8-3432-4cd6-b4fd-0dc9d51576b9')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13a453d0-49, col_values=(('external_ids', {'iface-id': '13a453d0-49aa-49ed-8032-18101893f071', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:47:51', 'vm-uuid': '54c60b45-04dc-4d3b-96ec-c2d0f583cafa'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:04 user nova-compute[75293]: INFO os_vif [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:47:51,bridge_name='br-int',has_traffic_filtering=True,id=13a453d0-49aa-49ed-8032-18101893f071,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13a453d0-49')
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:21:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] No VIF found with MAC fa:16:3e:59:47:51, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:21:05 user nova-compute[75293]: DEBUG nova.network.neutron [req-d71d6e51-1cb5-4cc2-a89e-946ec5bc38f6 req-ef42576f-d1fd-4023-a6c2-45096961e035 service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Updated VIF entry in instance network info cache for port 13a453d0-49aa-49ed-8032-18101893f071. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:21:05 user nova-compute[75293]: DEBUG nova.network.neutron [req-d71d6e51-1cb5-4cc2-a89e-946ec5bc38f6 req-ef42576f-d1fd-4023-a6c2-45096961e035 service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Updating instance_info_cache with network_info: [{"id": "13a453d0-49aa-49ed-8032-18101893f071", "address": "fa:16:3e:59:47:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a453d0-49", "ovs_interfaceid": "13a453d0-49aa-49ed-8032-18101893f071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:21:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d71d6e51-1cb5-4cc2-a89e-946ec5bc38f6 req-ef42576f-d1fd-4023-a6c2-45096961e035 service nova] Releasing lock "refresh_cache-54c60b45-04dc-4d3b-96ec-c2d0f583cafa" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:21:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-f83c1033-2431-42b1-8f8a-4fe7f4998c1b req-94b4e1ca-7e5e-495e-b4a6-396c387a13db service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Received event network-vif-plugged-13a453d0-49aa-49ed-8032-18101893f071 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:21:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f83c1033-2431-42b1-8f8a-4fe7f4998c1b req-94b4e1ca-7e5e-495e-b4a6-396c387a13db service nova] Acquiring lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f83c1033-2431-42b1-8f8a-4fe7f4998c1b req-94b4e1ca-7e5e-495e-b4a6-396c387a13db service nova] Lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f83c1033-2431-42b1-8f8a-4fe7f4998c1b req-94b4e1ca-7e5e-495e-b4a6-396c387a13db service nova] Lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-f83c1033-2431-42b1-8f8a-4fe7f4998c1b req-94b4e1ca-7e5e-495e-b4a6-396c387a13db service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] No waiting events found dispatching network-vif-plugged-13a453d0-49aa-49ed-8032-18101893f071 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:21:06 user nova-compute[75293]: WARNING nova.compute.manager [req-f83c1033-2431-42b1-8f8a-4fe7f4998c1b req-94b4e1ca-7e5e-495e-b4a6-396c387a13db service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Received unexpected event network-vif-plugged-13a453d0-49aa-49ed-8032-18101893f071 for instance with vm_state building and task_state spawning.
Nov 30 07:21:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:08 user nova-compute[75293]: DEBUG nova.compute.manager [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:21:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:21:08 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Instance spawned successfully.
Nov 30 07:21:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:21:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:21:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:21:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:21:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:21:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:21:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:21:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-9486a511-504f-42d9-b11d-3a5f0c886d51 req-a0358df7-c69d-4235-a027-ec5489cd200e service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Received event network-vif-plugged-13a453d0-49aa-49ed-8032-18101893f071 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:21:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9486a511-504f-42d9-b11d-3a5f0c886d51 req-a0358df7-c69d-4235-a027-ec5489cd200e service nova] Acquiring lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9486a511-504f-42d9-b11d-3a5f0c886d51 req-a0358df7-c69d-4235-a027-ec5489cd200e service nova] Lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9486a511-504f-42d9-b11d-3a5f0c886d51 req-a0358df7-c69d-4235-a027-ec5489cd200e service nova] Lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-9486a511-504f-42d9-b11d-3a5f0c886d51 req-a0358df7-c69d-4235-a027-ec5489cd200e service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] No waiting events found dispatching network-vif-plugged-13a453d0-49aa-49ed-8032-18101893f071 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:21:08 user nova-compute[75293]: WARNING nova.compute.manager [req-9486a511-504f-42d9-b11d-3a5f0c886d51 req-a0358df7-c69d-4235-a027-ec5489cd200e service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Received unexpected event network-vif-plugged-13a453d0-49aa-49ed-8032-18101893f071 for instance with vm_state building and task_state spawning.
Nov 30 07:21:08 user nova-compute[75293]: INFO nova.compute.manager [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 30 07:21:08 user nova-compute[75293]: DEBUG nova.compute.manager [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:21:08 user nova-compute[75293]: INFO nova.compute.manager [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Took 6.40 seconds to build instance.
Nov 30 07:21:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97384218-1b72-468a-a26d-296d368651c5 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.510s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:18 user nova-compute[75293]: INFO nova.compute.manager [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Detaching volume bdd84a2f-6e8d-4cd1-91a3-dcbcae822805
Nov 30 07:21:18 user nova-compute[75293]: INFO nova.virt.block_device [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Attempting to driver detach volume bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 from mountpoint /dev/vdb
Nov 30 07:21:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Attempting to detach device vdb from instance 4ebf0be9-15e0-418c-a554-7885c79a725b from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:21:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:21:18 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:21:18 user nova-compute[75293]:   <source dev="/dev/sdb"/>
Nov 30 07:21:18 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:21:18 user nova-compute[75293]:   <serial>bdd84a2f-6e8d-4cd1-91a3-dcbcae822805</serial>
Nov 30 07:21:18 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:21:18 user nova-compute[75293]: </disk>
Nov 30 07:21:18 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:21:18 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Successfully detached device vdb from instance 4ebf0be9-15e0-418c-a554-7885c79a725b from the persistent domain config.
Nov 30 07:21:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4ebf0be9-15e0-418c-a554-7885c79a725b from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:21:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:21:18 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:21:18 user nova-compute[75293]:   <source dev="/dev/sdb"/>
Nov 30 07:21:18 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:21:18 user nova-compute[75293]:   <serial>bdd84a2f-6e8d-4cd1-91a3-dcbcae822805</serial>
Nov 30 07:21:18 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:21:18 user nova-compute[75293]: </disk>
Nov 30 07:21:18 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:21:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4ebf0be9-15e0-418c-a554-7885c79a725b {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:21:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-73b18ea3-7d56-446f-abd0-c61c5636ac88 req-332bfad1-4f8a-49f7-a8dd-6ac7d8fe44e9 service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Received event network-changed-b47caadd-df9c-46df-99fe-24210b7a4f1c {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:21:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-73b18ea3-7d56-446f-abd0-c61c5636ac88 req-332bfad1-4f8a-49f7-a8dd-6ac7d8fe44e9 service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Refreshing instance network info cache due to event network-changed-b47caadd-df9c-46df-99fe-24210b7a4f1c. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:21:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-73b18ea3-7d56-446f-abd0-c61c5636ac88 req-332bfad1-4f8a-49f7-a8dd-6ac7d8fe44e9 service nova] Acquiring lock "refresh_cache-d34f99fc-343e-4e8a-83e6-372b0326bded" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:21:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-73b18ea3-7d56-446f-abd0-c61c5636ac88 req-332bfad1-4f8a-49f7-a8dd-6ac7d8fe44e9 service nova] Acquired lock "refresh_cache-d34f99fc-343e-4e8a-83e6-372b0326bded" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:21:32 user nova-compute[75293]: DEBUG nova.network.neutron [req-73b18ea3-7d56-446f-abd0-c61c5636ac88 req-332bfad1-4f8a-49f7-a8dd-6ac7d8fe44e9 service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Refreshing network info cache for port b47caadd-df9c-46df-99fe-24210b7a4f1c {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:21:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "d34f99fc-343e-4e8a-83e6-372b0326bded" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "d34f99fc-343e-4e8a-83e6-372b0326bded" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "d34f99fc-343e-4e8a-83e6-372b0326bded-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "d34f99fc-343e-4e8a-83e6-372b0326bded-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "d34f99fc-343e-4e8a-83e6-372b0326bded-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:32 user nova-compute[75293]: INFO nova.compute.manager [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Terminating instance
Nov 30 07:21:32 user nova-compute[75293]: DEBUG nova.compute.manager [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:21:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:33 user nova-compute[75293]: DEBUG nova.network.neutron [req-73b18ea3-7d56-446f-abd0-c61c5636ac88 req-332bfad1-4f8a-49f7-a8dd-6ac7d8fe44e9 service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Updated VIF entry in instance network info cache for port b47caadd-df9c-46df-99fe-24210b7a4f1c. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:21:33 user nova-compute[75293]: DEBUG nova.network.neutron [req-73b18ea3-7d56-446f-abd0-c61c5636ac88 req-332bfad1-4f8a-49f7-a8dd-6ac7d8fe44e9 service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Updating instance_info_cache with network_info: [{"id": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "address": "fa:16:3e:d8:cd:81", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47caadd-df", "ovs_interfaceid": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:21:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-73b18ea3-7d56-446f-abd0-c61c5636ac88 req-332bfad1-4f8a-49f7-a8dd-6ac7d8fe44e9 service nova] Releasing lock "refresh_cache-d34f99fc-343e-4e8a-83e6-372b0326bded" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:21:33 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Instance destroyed successfully.
Nov 30 07:21:33 user nova-compute[75293]: DEBUG nova.objects.instance [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lazy-loading 'resources' on Instance uuid d34f99fc-343e-4e8a-83e6-372b0326bded {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:21:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-431831329',display_name='tempest-TestStampPattern-server-431831329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-431831329',id=21,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0qMxl7UVzzNRBhKaK7jCT6r/53GRkB3Di+2AcuMeqPobnGiie2ivpr0tiN4y2/+N5eqEzUQwswDBS+N1ym58HFieIzNbbIOVxlbtYOwXvyj9jGINm6Alzpe31PR/dT3g==',key_name='tempest-TestStampPattern-1639076054',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:14:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3973d2dcb7674ea5b11eb2007f26df78',ramdisk_id='',reservation_id='r-guisa0ah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1058543327',owner_user_name='tempest-TestStampPattern-1058543327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:17:34Z,user_data=None,user_id='bec86b562bb54d7c9e10d8ce99723460',uuid=d34f99fc-343e-4e8a-83e6-372b0326bded,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "address": "fa:16:3e:d8:cd:81", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47caadd-df", "ovs_interfaceid": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:21:33 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Converting VIF {"id": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "address": "fa:16:3e:d8:cd:81", "network": {"id": "bab4085c-ab04-4e03-912e-6c6c8fde90b1", "bridge": "br-int", "label": "tempest-TestStampPattern-27937143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3973d2dcb7674ea5b11eb2007f26df78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47caadd-df", "ovs_interfaceid": "b47caadd-df9c-46df-99fe-24210b7a4f1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:21:33 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=b47caadd-df9c-46df-99fe-24210b7a4f1c,network=Network(bab4085c-ab04-4e03-912e-6c6c8fde90b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47caadd-df') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:21:33 user nova-compute[75293]: DEBUG os_vif [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=b47caadd-df9c-46df-99fe-24210b7a4f1c,network=Network(bab4085c-ab04-4e03-912e-6c6c8fde90b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47caadd-df') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:21:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb47caadd-df, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:21:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:21:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d86b1ae5-a28d-4f4f-a77f-94aa25ec942e) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:21:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:21:33 user nova-compute[75293]: INFO os_vif [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=b47caadd-df9c-46df-99fe-24210b7a4f1c,network=Network(bab4085c-ab04-4e03-912e-6c6c8fde90b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb47caadd-df')
Nov 30 07:21:33 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Deleting instance files /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded_del
Nov 30 07:21:33 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Deletion of /opt/stack/data/nova/instances/d34f99fc-343e-4e8a-83e6-372b0326bded_del complete
Nov 30 07:21:33 user nova-compute[75293]: INFO nova.compute.manager [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 30 07:21:33 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:21:33 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:21:33 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:21:33 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:21:34 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Took 0.44 seconds to deallocate network for instance.
Nov 30 07:21:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:34 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:21:34 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:21:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:34 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Deleted allocations for instance d34f99fc-343e-4e8a-83e6-372b0326bded
Nov 30 07:21:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-14fc5e4b-d98b-4a07-b9fd-8c94e3378b1d tempest-TestStampPattern-1058543327 tempest-TestStampPattern-1058543327-project-member] Lock "d34f99fc-343e-4e8a-83e6-372b0326bded" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.822s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:34 user nova-compute[75293]: DEBUG nova.compute.manager [req-baf3d121-516a-49e0-a86f-8da291a78e15 req-9dce7417-f40b-4b24-8b5a-bc343260f7f8 service nova] [instance: d34f99fc-343e-4e8a-83e6-372b0326bded] Received event network-vif-deleted-b47caadd-df9c-46df-99fe-24210b7a4f1c {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:21:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:38 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4ebf0be9-15e0-418c-a554-7885c79a725b is timed out.
Nov 30 07:21:38 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Successfully detached device vdb from instance 4ebf0be9-15e0-418c-a554-7885c79a725b from the live domain config.
Nov 30 07:21:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:21:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVXbqNjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:21:38 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:21:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:21:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:21:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[14feae97-a4fa-4901-be22-6fac8df5dc9c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:21:39 user nova-compute[75293]: No targets found.
Nov 30 07:21:39 user nova-compute[75293]: iSNS:
Nov 30 07:21:39 user nova-compute[75293]: No targets found.
Nov 30 07:21:39 user nova-compute[75293]: STATIC:
Nov 30 07:21:39 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:21:39 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:21:39 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:21:39 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805
Nov 30 07:21:39 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:21:39 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:21:39 user nova-compute[75293]: FIRMWARE:
Nov 30 07:21:39 user nova-compute[75293]: No targets found.
Nov 30 07:21:39 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:21:39 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:21:39 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[850e279f-c8a4-483f-90d0-747f57c8c696]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef50b412-3b4f-46d3-9ae3-af851657be1b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:21:39 user nova-compute[75293]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 (non-flash)
Nov 30 07:21:39 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:21:39 user nova-compute[75293]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 (non-flash)
Nov 30 07:21:39 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe83d7400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805'): ({'sdb'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Removing single pathed devices sdb {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f19f2fa-c9e6-42b4-bcb1-380d425bb87c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3de0a7d-06a7-43c2-ba73-4592bc7a3f8b]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Flushing IO for device /dev/sdb {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[987e87a2-b7cb-49a4-9a07-f9147459190c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd8dc02-3fb2-4b5e-8443-18d6cd8359db]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[823336f5-067f-4ca1-afa8-3410a0118c70]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --logout" returned: 0 in 0.133s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b55ffb7-3005-429e-990e-26e99e743f54]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805, portal: 172.16.0.220,3260]
Nov 30 07:21:39 user nova-compute[75293]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805, portal: 172.16.0.220,3260] successful.
Nov 30 07:21:39 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd84a2f-6e8d-4cd1-91a3-dcbcae822805 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fb2f4c-0fde-48e0-90d3-d411611f1f67]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] <== disconnect_volume: return (416ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:21:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:21:40 user nova-compute[75293]: DEBUG nova.objects.instance [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lazy-loading 'flavor' on Instance uuid 4ebf0be9-15e0-418c-a554-7885c79a725b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:21:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ebd13e34-169f-4320-bac1-2c18dfc9abab tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.923s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "d89452ef-96ab-4081-bc40-0f64968de367" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "d89452ef-96ab-4081-bc40-0f64968de367" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:41 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:21:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:41 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:21:41 user nova-compute[75293]: INFO nova.compute.claims [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Claim successful on node user
Nov 30 07:21:41 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:21:41 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:21:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:41 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:21:41 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:21:41 user nova-compute[75293]: DEBUG nova.network.neutron [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:21:41 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:21:41 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:21:41 user nova-compute[75293]: DEBUG nova.policy [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fb08d8e90be4f6eb2efd21f2cbf2dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e631f0d47cc43a1b670e1b78b482e67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:21:41 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:21:41 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:21:41 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Creating image(s)
Nov 30 07:21:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "/opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "/opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "/opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:41 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.181s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.175s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk 1073741824" returned: 0 in 0.056s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.184s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG nova.network.neutron [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Successfully created port: 0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Cannot resize image /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Ensure instance console log exists: /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.network.neutron [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Successfully updated port: 0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquired lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.network.neutron [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-21f3dfc9-69e2-41de-af53-0c03f4b4992a req-c95ab42c-eaf8-4ce1-ac4a-3544b1b0d08f service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received event network-changed-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-21f3dfc9-69e2-41de-af53-0c03f4b4992a req-c95ab42c-eaf8-4ce1-ac4a-3544b1b0d08f service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Refreshing instance network info cache due to event network-changed-0b9bbab7-780f-4b09-9c9b-4448e8ff2323. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-21f3dfc9-69e2-41de-af53-0c03f4b4992a req-c95ab42c-eaf8-4ce1-ac4a-3544b1b0d08f service nova] Acquiring lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "41791107-ce7b-4bab-888c-cb84618646d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "41791107-ce7b-4bab-888c-cb84618646d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.compute.manager [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.network.neutron [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:21:43 user nova-compute[75293]: INFO nova.compute.claims [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Claim successful on node user
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.network.neutron [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Updating instance_info_cache with network_info: [{"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Releasing lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Instance network_info: |[{"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-21f3dfc9-69e2-41de-af53-0c03f4b4992a req-c95ab42c-eaf8-4ce1-ac4a-3544b1b0d08f service nova] Acquired lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.network.neutron [req-21f3dfc9-69e2-41de-af53-0c03f4b4992a req-c95ab42c-eaf8-4ce1-ac4a-3544b1b0d08f service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Refreshing network info cache for port 0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Start _get_guest_xml network_info=[{"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:21:43 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:21:43 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1953113672',display_name='tempest-ServerActionsTestOtherB-server-1953113672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1953113672',id=35,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnRjCaWy780if2CkUOoZrcrdcD+P1g/YJnFZ7z8Y8pV7AT42ymHjcVO5HJTfrEuy5cWDNDXLYAnT+pwSMKRHRG0FXx2bJrOk/qq7N46wXruznAxyX6mXSnteMjD8Ewz6w==',key_name='tempest-keypair-319510887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e631f0d47cc43a1b670e1b78b482e67',ramdisk_id='',reservation_id='r-mjklwfn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-70269142',owner_user_name='tempest-ServerActionsTestOtherB-70269142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fb08d8e90be4f6eb2efd21f2cbf2dcd',uuid=d89452ef-96ab-4081-bc40-0f64968de367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Converting VIF {"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.objects.instance [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lazy-loading 'pci_devices' on Instance uuid d89452ef-96ab-4081-bc40-0f64968de367 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:21:43 user nova-compute[75293]:   <uuid>d89452ef-96ab-4081-bc40-0f64968de367</uuid>
Nov 30 07:21:43 user nova-compute[75293]:   <name>instance-00000023</name>
Nov 30 07:21:43 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:21:43 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:21:43 user nova-compute[75293]:   <metadata>
Nov 30 07:21:43 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:21:43 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:21:43 user nova-compute[75293]:       <nova:name>tempest-ServerActionsTestOtherB-server-1953113672</nova:name>
Nov 30 07:21:43 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:21:43</nova:creationTime>
Nov 30 07:21:43 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:21:43 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:21:43 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:21:43 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:21:43 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:21:43 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:21:43 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:21:43 user nova-compute[75293]:       <nova:owner>
Nov 30 07:21:43 user nova-compute[75293]:         <nova:user uuid="6fb08d8e90be4f6eb2efd21f2cbf2dcd">tempest-ServerActionsTestOtherB-70269142-project-member</nova:user>
Nov 30 07:21:43 user nova-compute[75293]:         <nova:project uuid="2e631f0d47cc43a1b670e1b78b482e67">tempest-ServerActionsTestOtherB-70269142</nova:project>
Nov 30 07:21:43 user nova-compute[75293]:       </nova:owner>
Nov 30 07:21:43 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:21:43 user nova-compute[75293]:       <nova:ports>
Nov 30 07:21:43 user nova-compute[75293]:         <nova:port uuid="0b9bbab7-780f-4b09-9c9b-4448e8ff2323">
Nov 30 07:21:43 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 07:21:43 user nova-compute[75293]:         </nova:port>
Nov 30 07:21:43 user nova-compute[75293]:       </nova:ports>
Nov 30 07:21:43 user nova-compute[75293]:     </nova:instance>
Nov 30 07:21:43 user nova-compute[75293]:   </metadata>
Nov 30 07:21:43 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:21:43 user nova-compute[75293]:     <system>
Nov 30 07:21:43 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:21:43 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:21:43 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:21:43 user nova-compute[75293]:       <entry name="serial">d89452ef-96ab-4081-bc40-0f64968de367</entry>
Nov 30 07:21:43 user nova-compute[75293]:       <entry name="uuid">d89452ef-96ab-4081-bc40-0f64968de367</entry>
Nov 30 07:21:43 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:21:43 user nova-compute[75293]:     </system>
Nov 30 07:21:43 user nova-compute[75293]:   </sysinfo>
Nov 30 07:21:43 user nova-compute[75293]:   <os>
Nov 30 07:21:43 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:21:43 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:21:43 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:21:43 user nova-compute[75293]:   </os>
Nov 30 07:21:43 user nova-compute[75293]:   <features>
Nov 30 07:21:43 user nova-compute[75293]:     <acpi/>
Nov 30 07:21:43 user nova-compute[75293]:     <apic/>
Nov 30 07:21:43 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:21:43 user nova-compute[75293]:   </features>
Nov 30 07:21:43 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:21:43 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:21:43 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:21:43 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:21:43 user nova-compute[75293]:   </clock>
Nov 30 07:21:43 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:21:43 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:21:43 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:21:43 user nova-compute[75293]:   </cpu>
Nov 30 07:21:43 user nova-compute[75293]:   <devices>
Nov 30 07:21:43 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:21:43 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:21:43 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk"/>
Nov 30 07:21:43 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:21:43 user nova-compute[75293]:     </disk>
Nov 30 07:21:43 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:21:43 user nova-compute[75293]:       <mac address="fa:16:3e:8c:ff:ac"/>
Nov 30 07:21:43 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:21:43 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:21:43 user nova-compute[75293]:       <target dev="tap0b9bbab7-78"/>
Nov 30 07:21:43 user nova-compute[75293]:     </interface>
Nov 30 07:21:43 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:21:43 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/console.log" append="off"/>
Nov 30 07:21:43 user nova-compute[75293]:     </serial>
Nov 30 07:21:43 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:21:43 user nova-compute[75293]:     <video>
Nov 30 07:21:43 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:21:43 user nova-compute[75293]:     </video>
Nov 30 07:21:43 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:21:43 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:21:43 user nova-compute[75293]:     </rng>
Nov 30 07:21:43 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:21:43 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:21:43 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:21:43 user nova-compute[75293]:     </memballoon>
Nov 30 07:21:43 user nova-compute[75293]:   </devices>
Nov 30 07:21:43 user nova-compute[75293]: </domain>
Nov 30 07:21:43 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1953113672',display_name='tempest-ServerActionsTestOtherB-server-1953113672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1953113672',id=35,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnRjCaWy780if2CkUOoZrcrdcD+P1g/YJnFZ7z8Y8pV7AT42ymHjcVO5HJTfrEuy5cWDNDXLYAnT+pwSMKRHRG0FXx2bJrOk/qq7N46wXruznAxyX6mXSnteMjD8Ewz6w==',key_name='tempest-keypair-319510887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e631f0d47cc43a1b670e1b78b482e67',ramdisk_id='',reservation_id='r-mjklwfn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-70269142',owner_user_name='tempest-ServerActionsTestOtherB-70269142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fb08d8e90be4f6eb2efd21f2cbf2dcd',uuid=d89452ef-96ab-4081-bc40-0f64968de367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Converting VIF {"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG os_vif [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7250f6d9-b0d5-5c3e-b2da-7787ad110cdc', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b9bbab7-78, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b9bbab7-78, col_values=(('qos', UUID('e20e843e-79d5-4700-a83d-069e3096cd0f')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b9bbab7-78, col_values=(('external_ids', {'iface-id': '0b9bbab7-780f-4b09-9c9b-4448e8ff2323', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:ff:ac', 'vm-uuid': 'd89452ef-96ab-4081-bc40-0f64968de367'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:21:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:43 user nova-compute[75293]: INFO os_vif [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78')
Nov 30 07:21:44 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:21:44 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:21:44 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] No VIF found with MAC fa:16:3e:8c:ff:ac, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:21:44 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:21:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:44 user nova-compute[75293]: DEBUG nova.compute.manager [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:21:44 user nova-compute[75293]: DEBUG nova.compute.manager [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:21:44 user nova-compute[75293]: DEBUG nova.network.neutron [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:21:44 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:21:44 user nova-compute[75293]: DEBUG nova.compute.manager [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:21:44 user nova-compute[75293]: DEBUG nova.policy [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbee62d1b15144cc9d433a4a64dd12a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa84ea3874ba7ac0af4c3b1d2f918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:21:44 user nova-compute[75293]: INFO nova.virt.block_device [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Booting with volume snapshot 20ff6d12-1c5d-465b-be91-6d1f817ff618 at /dev/vda
Nov 30 07:21:44 user nova-compute[75293]: DEBUG nova.network.neutron [req-21f3dfc9-69e2-41de-af53-0c03f4b4992a req-c95ab42c-eaf8-4ce1-ac4a-3544b1b0d08f service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Updated VIF entry in instance network info cache for port 0b9bbab7-780f-4b09-9c9b-4448e8ff2323. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:21:44 user nova-compute[75293]: DEBUG nova.network.neutron [req-21f3dfc9-69e2-41de-af53-0c03f4b4992a req-c95ab42c-eaf8-4ce1-ac4a-3544b1b0d08f service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Updating instance_info_cache with network_info: [{"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:21:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-21f3dfc9-69e2-41de-af53-0c03f4b4992a req-c95ab42c-eaf8-4ce1-ac4a-3544b1b0d08f service nova] Releasing lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:21:44 user nova-compute[75293]: DEBUG nova.network.neutron [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Successfully created port: 3d00dd6e-5542-414d-8b35-fa40298b43af {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:21:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:45 user nova-compute[75293]: DEBUG nova.network.neutron [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Successfully updated port: 3d00dd6e-5542-414d-8b35-fa40298b43af {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:21:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "refresh_cache-41791107-ce7b-4bab-888c-cb84618646d1" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:21:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquired lock "refresh_cache-41791107-ce7b-4bab-888c-cb84618646d1" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:21:45 user nova-compute[75293]: DEBUG nova.network.neutron [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:21:45 user nova-compute[75293]: DEBUG nova.compute.manager [req-f775b46f-c30a-4242-9cc7-ed06c6972c7c req-0239202f-82a7-4bba-bf45-8405e1d07c7f service nova] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Received event network-changed-3d00dd6e-5542-414d-8b35-fa40298b43af {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:21:45 user nova-compute[75293]: DEBUG nova.compute.manager [req-f775b46f-c30a-4242-9cc7-ed06c6972c7c req-0239202f-82a7-4bba-bf45-8405e1d07c7f service nova] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Refreshing instance network info cache due to event network-changed-3d00dd6e-5542-414d-8b35-fa40298b43af. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:21:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f775b46f-c30a-4242-9cc7-ed06c6972c7c req-0239202f-82a7-4bba-bf45-8405e1d07c7f service nova] Acquiring lock "refresh_cache-41791107-ce7b-4bab-888c-cb84618646d1" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:21:45 user nova-compute[75293]: DEBUG nova.network.neutron [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:21:45 user nova-compute[75293]: DEBUG nova.network.neutron [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Updating instance_info_cache with network_info: [{"id": "3d00dd6e-5542-414d-8b35-fa40298b43af", "address": "fa:16:3e:9f:20:c2", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00dd6e-55", "ovs_interfaceid": "3d00dd6e-5542-414d-8b35-fa40298b43af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:21:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Releasing lock "refresh_cache-41791107-ce7b-4bab-888c-cb84618646d1" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:21:45 user nova-compute[75293]: DEBUG nova.compute.manager [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Instance network_info: |[{"id": "3d00dd6e-5542-414d-8b35-fa40298b43af", "address": "fa:16:3e:9f:20:c2", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00dd6e-55", "ovs_interfaceid": "3d00dd6e-5542-414d-8b35-fa40298b43af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:21:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f775b46f-c30a-4242-9cc7-ed06c6972c7c req-0239202f-82a7-4bba-bf45-8405e1d07c7f service nova] Acquired lock "refresh_cache-41791107-ce7b-4bab-888c-cb84618646d1" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:21:45 user nova-compute[75293]: DEBUG nova.network.neutron [req-f775b46f-c30a-4242-9cc7-ed06c6972c7c req-0239202f-82a7-4bba-bf45-8405e1d07c7f service nova] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Refreshing network info cache for port 3d00dd6e-5542-414d-8b35-fa40298b43af {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:21:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:46 user nova-compute[75293]: DEBUG nova.network.neutron [req-f775b46f-c30a-4242-9cc7-ed06c6972c7c req-0239202f-82a7-4bba-bf45-8405e1d07c7f service nova] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Updated VIF entry in instance network info cache for port 3d00dd6e-5542-414d-8b35-fa40298b43af. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:21:46 user nova-compute[75293]: DEBUG nova.network.neutron [req-f775b46f-c30a-4242-9cc7-ed06c6972c7c req-0239202f-82a7-4bba-bf45-8405e1d07c7f service nova] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Updating instance_info_cache with network_info: [{"id": "3d00dd6e-5542-414d-8b35-fa40298b43af", "address": "fa:16:3e:9f:20:c2", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00dd6e-55", "ovs_interfaceid": "3d00dd6e-5542-414d-8b35-fa40298b43af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:21:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-f775b46f-c30a-4242-9cc7-ed06c6972c7c req-0239202f-82a7-4bba-bf45-8405e1d07c7f service nova] Releasing lock "refresh_cache-41791107-ce7b-4bab-888c-cb84618646d1" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:21:47 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:21:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:21:47 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Instance spawned successfully.
Nov 30 07:21:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:21:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:21:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:21:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:21:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:21:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:21:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:21:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-4a0e4c45-5403-45d7-be5b-4e893311bfbc req-b6e9e1ac-651e-4c88-b056-88fc0da71795 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received event network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:21:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4a0e4c45-5403-45d7-be5b-4e893311bfbc req-b6e9e1ac-651e-4c88-b056-88fc0da71795 service nova] Acquiring lock "d89452ef-96ab-4081-bc40-0f64968de367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4a0e4c45-5403-45d7-be5b-4e893311bfbc req-b6e9e1ac-651e-4c88-b056-88fc0da71795 service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4a0e4c45-5403-45d7-be5b-4e893311bfbc req-b6e9e1ac-651e-4c88-b056-88fc0da71795 service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-4a0e4c45-5403-45d7-be5b-4e893311bfbc req-b6e9e1ac-651e-4c88-b056-88fc0da71795 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] No waiting events found dispatching network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:21:47 user nova-compute[75293]: WARNING nova.compute.manager [req-4a0e4c45-5403-45d7-be5b-4e893311bfbc req-b6e9e1ac-651e-4c88-b056-88fc0da71795 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received unexpected event network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 for instance with vm_state building and task_state spawning.
Nov 30 07:21:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-4a0e4c45-5403-45d7-be5b-4e893311bfbc req-b6e9e1ac-651e-4c88-b056-88fc0da71795 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received event network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:21:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4a0e4c45-5403-45d7-be5b-4e893311bfbc req-b6e9e1ac-651e-4c88-b056-88fc0da71795 service nova] Acquiring lock "d89452ef-96ab-4081-bc40-0f64968de367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4a0e4c45-5403-45d7-be5b-4e893311bfbc req-b6e9e1ac-651e-4c88-b056-88fc0da71795 service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4a0e4c45-5403-45d7-be5b-4e893311bfbc req-b6e9e1ac-651e-4c88-b056-88fc0da71795 service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-4a0e4c45-5403-45d7-be5b-4e893311bfbc req-b6e9e1ac-651e-4c88-b056-88fc0da71795 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] No waiting events found dispatching network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:21:47 user nova-compute[75293]: WARNING nova.compute.manager [req-4a0e4c45-5403-45d7-be5b-4e893311bfbc req-b6e9e1ac-651e-4c88-b056-88fc0da71795 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received unexpected event network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 for instance with vm_state building and task_state spawning.
Nov 30 07:21:47 user nova-compute[75293]: INFO nova.compute.manager [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 30 07:21:47 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:21:47 user nova-compute[75293]: INFO nova.compute.manager [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Took 6.32 seconds to build instance.
Nov 30 07:21:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6d61c262-d678-4f45-9709-e466660c943f tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "d89452ef-96ab-4081-bc40-0f64968de367" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.446s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:49 user nova-compute[75293]: DEBUG os_brick.utils [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:21:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[907ec944-2c46-4e3a-abd9-145db77dfa13]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95b9d19-deb6-45e5-9b46-88a930ce5188]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:50 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ed0520-5e13-46a6-b7a5-9655ea92a1e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:50 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f55598-1f39-4091-ac38-5d29facd2bc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:21:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:21:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:21:50 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:21:50 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f854b14-8ea2-417a-8f9c-0d23babbd084]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:21:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:21:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:21:50 user nova-compute[75293]: DEBUG os_brick.utils [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:21:50 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Updating existing volume attachment record: b4873205-9482-4de5-9948-0416034a764f {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:21:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "26b50488-cf81-4241-ade7-95044312ceba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "26b50488-cf81-4241-ade7-95044312ceba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:51 user nova-compute[75293]: DEBUG nova.compute.manager [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:21:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:52 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:21:52 user nova-compute[75293]: INFO nova.compute.claims [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Claim successful on node user
Nov 30 07:21:52 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:21:52 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:21:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:52 user nova-compute[75293]: DEBUG nova.compute.manager [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:21:52 user nova-compute[75293]: DEBUG nova.compute.manager [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:21:52 user nova-compute[75293]: DEBUG nova.network.neutron [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:21:52 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:21:52 user nova-compute[75293]: DEBUG nova.compute.manager [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:21:52 user nova-compute[75293]: DEBUG nova.policy [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abe34a1b2c38472d831ae5d7afa85c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ff34b2e2c047319c1fe166c5029790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:21:52 user nova-compute[75293]: DEBUG nova.compute.manager [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:21:52 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:21:52 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Creating image(s)
Nov 30 07:21:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "/opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "/opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "/opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.187s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.199s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk 1073741824" returned: 0 in 0.059s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.196s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:53 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:21:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:53 user nova-compute[75293]: DEBUG nova.network.neutron [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Successfully created port: 5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:21:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:53 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Cannot resize image /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:21:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:21:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Ensure instance console log exists: /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:21:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.network.neutron [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Successfully updated port: 5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "refresh_cache-26b50488-cf81-4241-ade7-95044312ceba" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquired lock "refresh_cache-26b50488-cf81-4241-ade7-95044312ceba" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.network.neutron [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.compute.manager [req-6ede57cc-edb7-4444-9978-50c337106644 req-402935f4-11b0-43f4-aa7a-6d15515d01d5 service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Received event network-changed-5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.compute.manager [req-6ede57cc-edb7-4444-9978-50c337106644 req-402935f4-11b0-43f4-aa7a-6d15515d01d5 service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Refreshing instance network info cache due to event network-changed-5f826266-d1bb-4ef6-add4-41a7fb145fe4. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6ede57cc-edb7-4444-9978-50c337106644 req-402935f4-11b0-43f4-aa7a-6d15515d01d5 service nova] Acquiring lock "refresh_cache-26b50488-cf81-4241-ade7-95044312ceba" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.network.neutron [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.network.neutron [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Updating instance_info_cache with network_info: [{"id": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "address": "fa:16:3e:b0:0e:0b", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f826266-d1", "ovs_interfaceid": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Releasing lock "refresh_cache-26b50488-cf81-4241-ade7-95044312ceba" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.compute.manager [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Instance network_info: |[{"id": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "address": "fa:16:3e:b0:0e:0b", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f826266-d1", "ovs_interfaceid": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6ede57cc-edb7-4444-9978-50c337106644 req-402935f4-11b0-43f4-aa7a-6d15515d01d5 service nova] Acquired lock "refresh_cache-26b50488-cf81-4241-ade7-95044312ceba" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.network.neutron [req-6ede57cc-edb7-4444-9978-50c337106644 req-402935f4-11b0-43f4-aa7a-6d15515d01d5 service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Refreshing network info cache for port 5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Start _get_guest_xml network_info=[{"id": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "address": "fa:16:3e:b0:0e:0b", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f826266-d1", "ovs_interfaceid": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:21:54 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:21:54 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:21:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1485978704',display_name='tempest-AttachVolumeNegativeTest-server-1485978704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1485978704',id=37,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEECe7dMj0qydDG31h1Tj/zo2fcB3dEQzOSe98fJK3wGhjIz6IwPTHB6eHemv4DLp97bwQ8LbXcYSN7giep+TjVFr9fFhRRgl5abVEoL7H1mxTMbhVkbtbyKKxQNGbMIDQ==',key_name='tempest-keypair-112879234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68ff34b2e2c047319c1fe166c5029790',ramdisk_id='',reservation_id='r-7avgffk8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1915468397',owner_user_name='tempest-AttachVolumeNegativeTest-1915468397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe34a1b2c38472d831ae5d7afa85c77',uuid=26b50488-cf81-4241-ade7-95044312ceba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "address": "fa:16:3e:b0:0e:0b", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f826266-d1", "ovs_interfaceid": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converting VIF {"id": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "address": "fa:16:3e:b0:0e:0b", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f826266-d1", "ovs_interfaceid": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:0e:0b,bridge_name='br-int',has_traffic_filtering=True,id=5f826266-d1bb-4ef6-add4-41a7fb145fe4,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f826266-d1') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.objects.instance [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lazy-loading 'pci_devices' on Instance uuid 26b50488-cf81-4241-ade7-95044312ceba {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:21:54 user nova-compute[75293]:   <uuid>26b50488-cf81-4241-ade7-95044312ceba</uuid>
Nov 30 07:21:54 user nova-compute[75293]:   <name>instance-00000025</name>
Nov 30 07:21:54 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:21:54 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:21:54 user nova-compute[75293]:   <metadata>
Nov 30 07:21:54 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:21:54 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:21:54 user nova-compute[75293]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1485978704</nova:name>
Nov 30 07:21:54 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:21:54</nova:creationTime>
Nov 30 07:21:54 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:21:54 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:21:54 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:21:54 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:21:54 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:21:54 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:21:54 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:21:54 user nova-compute[75293]:       <nova:owner>
Nov 30 07:21:54 user nova-compute[75293]:         <nova:user uuid="abe34a1b2c38472d831ae5d7afa85c77">tempest-AttachVolumeNegativeTest-1915468397-project-member</nova:user>
Nov 30 07:21:54 user nova-compute[75293]:         <nova:project uuid="68ff34b2e2c047319c1fe166c5029790">tempest-AttachVolumeNegativeTest-1915468397</nova:project>
Nov 30 07:21:54 user nova-compute[75293]:       </nova:owner>
Nov 30 07:21:54 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:21:54 user nova-compute[75293]:       <nova:ports>
Nov 30 07:21:54 user nova-compute[75293]:         <nova:port uuid="5f826266-d1bb-4ef6-add4-41a7fb145fe4">
Nov 30 07:21:54 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 07:21:54 user nova-compute[75293]:         </nova:port>
Nov 30 07:21:54 user nova-compute[75293]:       </nova:ports>
Nov 30 07:21:54 user nova-compute[75293]:     </nova:instance>
Nov 30 07:21:54 user nova-compute[75293]:   </metadata>
Nov 30 07:21:54 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:21:54 user nova-compute[75293]:     <system>
Nov 30 07:21:54 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:21:54 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:21:54 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:21:54 user nova-compute[75293]:       <entry name="serial">26b50488-cf81-4241-ade7-95044312ceba</entry>
Nov 30 07:21:54 user nova-compute[75293]:       <entry name="uuid">26b50488-cf81-4241-ade7-95044312ceba</entry>
Nov 30 07:21:54 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:21:54 user nova-compute[75293]:     </system>
Nov 30 07:21:54 user nova-compute[75293]:   </sysinfo>
Nov 30 07:21:54 user nova-compute[75293]:   <os>
Nov 30 07:21:54 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:21:54 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:21:54 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:21:54 user nova-compute[75293]:   </os>
Nov 30 07:21:54 user nova-compute[75293]:   <features>
Nov 30 07:21:54 user nova-compute[75293]:     <acpi/>
Nov 30 07:21:54 user nova-compute[75293]:     <apic/>
Nov 30 07:21:54 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:21:54 user nova-compute[75293]:   </features>
Nov 30 07:21:54 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:21:54 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:21:54 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:21:54 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:21:54 user nova-compute[75293]:   </clock>
Nov 30 07:21:54 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:21:54 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:21:54 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:21:54 user nova-compute[75293]:   </cpu>
Nov 30 07:21:54 user nova-compute[75293]:   <devices>
Nov 30 07:21:54 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:21:54 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:21:54 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk"/>
Nov 30 07:21:54 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:21:54 user nova-compute[75293]:     </disk>
Nov 30 07:21:54 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:21:54 user nova-compute[75293]:       <mac address="fa:16:3e:b0:0e:0b"/>
Nov 30 07:21:54 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:21:54 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:21:54 user nova-compute[75293]:       <target dev="tap5f826266-d1"/>
Nov 30 07:21:54 user nova-compute[75293]:     </interface>
Nov 30 07:21:54 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:21:54 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/console.log" append="off"/>
Nov 30 07:21:54 user nova-compute[75293]:     </serial>
Nov 30 07:21:54 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:21:54 user nova-compute[75293]:     <video>
Nov 30 07:21:54 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:21:54 user nova-compute[75293]:     </video>
Nov 30 07:21:54 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:21:54 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:21:54 user nova-compute[75293]:     </rng>
Nov 30 07:21:54 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:21:54 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:21:54 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:21:54 user nova-compute[75293]:     </memballoon>
Nov 30 07:21:54 user nova-compute[75293]:   </devices>
Nov 30 07:21:54 user nova-compute[75293]: </domain>
Nov 30 07:21:54 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:21:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1485978704',display_name='tempest-AttachVolumeNegativeTest-server-1485978704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1485978704',id=37,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEECe7dMj0qydDG31h1Tj/zo2fcB3dEQzOSe98fJK3wGhjIz6IwPTHB6eHemv4DLp97bwQ8LbXcYSN7giep+TjVFr9fFhRRgl5abVEoL7H1mxTMbhVkbtbyKKxQNGbMIDQ==',key_name='tempest-keypair-112879234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68ff34b2e2c047319c1fe166c5029790',ramdisk_id='',reservation_id='r-7avgffk8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1915468397',owner_user_name='tempest-AttachVolumeNegativeTest-1915468397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe34a1b2c38472d831ae5d7afa85c77',uuid=26b50488-cf81-4241-ade7-95044312ceba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "address": "fa:16:3e:b0:0e:0b", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f826266-d1", "ovs_interfaceid": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converting VIF {"id": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "address": "fa:16:3e:b0:0e:0b", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f826266-d1", "ovs_interfaceid": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:0e:0b,bridge_name='br-int',has_traffic_filtering=True,id=5f826266-d1bb-4ef6-add4-41a7fb145fe4,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f826266-d1') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG os_vif [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:0e:0b,bridge_name='br-int',has_traffic_filtering=True,id=5f826266-d1bb-4ef6-add4-41a7fb145fe4,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f826266-d1') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '013d5aa8-81d8-5f4c-975b-31707b438aca', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f826266-d1, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f826266-d1, col_values=(('qos', UUID('75631c36-86d4-45d6-8ec3-e550761cf401')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f826266-d1, col_values=(('external_ids', {'iface-id': '5f826266-d1bb-4ef6-add4-41a7fb145fe4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:0e:0b', 'vm-uuid': '26b50488-cf81-4241-ade7-95044312ceba'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:54 user nova-compute[75293]: INFO os_vif [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:0e:0b,bridge_name='br-int',has_traffic_filtering=True,id=5f826266-d1bb-4ef6-add4-41a7fb145fe4,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f826266-d1')
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] No VIF found with MAC fa:16:3e:b0:0e:0b, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.network.neutron [req-6ede57cc-edb7-4444-9978-50c337106644 req-402935f4-11b0-43f4-aa7a-6d15515d01d5 service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Updated VIF entry in instance network info cache for port 5f826266-d1bb-4ef6-add4-41a7fb145fe4. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG nova.network.neutron [req-6ede57cc-edb7-4444-9978-50c337106644 req-402935f4-11b0-43f4-aa7a-6d15515d01d5 service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Updating instance_info_cache with network_info: [{"id": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "address": "fa:16:3e:b0:0e:0b", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f826266-d1", "ovs_interfaceid": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:21:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6ede57cc-edb7-4444-9978-50c337106644 req-402935f4-11b0-43f4-aa7a-6d15515d01d5 service nova] Releasing lock "refresh_cache-26b50488-cf81-4241-ade7-95044312ceba" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:21:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:56 user nova-compute[75293]: DEBUG nova.compute.manager [req-2e3bd39e-24e8-4552-9179-0e150200be88 req-859d35b9-08c3-476b-9b9a-12c6d7c98afa service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Received event network-vif-plugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:21:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2e3bd39e-24e8-4552-9179-0e150200be88 req-859d35b9-08c3-476b-9b9a-12c6d7c98afa service nova] Acquiring lock "26b50488-cf81-4241-ade7-95044312ceba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2e3bd39e-24e8-4552-9179-0e150200be88 req-859d35b9-08c3-476b-9b9a-12c6d7c98afa service nova] Lock "26b50488-cf81-4241-ade7-95044312ceba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2e3bd39e-24e8-4552-9179-0e150200be88 req-859d35b9-08c3-476b-9b9a-12c6d7c98afa service nova] Lock "26b50488-cf81-4241-ade7-95044312ceba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:56 user nova-compute[75293]: DEBUG nova.compute.manager [req-2e3bd39e-24e8-4552-9179-0e150200be88 req-859d35b9-08c3-476b-9b9a-12c6d7c98afa service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] No waiting events found dispatching network-vif-plugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:21:56 user nova-compute[75293]: WARNING nova.compute.manager [req-2e3bd39e-24e8-4552-9179-0e150200be88 req-859d35b9-08c3-476b-9b9a-12c6d7c98afa service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Received unexpected event network-vif-plugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 for instance with vm_state building and task_state spawning.
Nov 30 07:21:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:21:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:57 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:21:57 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:21:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-ed037c80-4f33-4e03-907c-18b4ea122411" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:21:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-ed037c80-4f33-4e03-907c-18b4ea122411" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:21:57 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Updating instance_info_cache with network_info: [{"id": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "address": "fa:16:3e:fe:7a:56", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap196acf39-31", "ovs_interfaceid": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG nova.compute.manager [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-ed037c80-4f33-4e03-907c-18b4ea122411" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG nova.compute.manager [req-6a47b5c4-ba8d-4b80-a235-beace0346305 req-fe171213-701c-4705-8cef-0fd7c4f16ecd service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Received event network-vif-plugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6a47b5c4-ba8d-4b80-a235-beace0346305 req-fe171213-701c-4705-8cef-0fd7c4f16ecd service nova] Acquiring lock "26b50488-cf81-4241-ade7-95044312ceba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6a47b5c4-ba8d-4b80-a235-beace0346305 req-fe171213-701c-4705-8cef-0fd7c4f16ecd service nova] Lock "26b50488-cf81-4241-ade7-95044312ceba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6a47b5c4-ba8d-4b80-a235-beace0346305 req-fe171213-701c-4705-8cef-0fd7c4f16ecd service nova] Lock "26b50488-cf81-4241-ade7-95044312ceba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG nova.compute.manager [req-6a47b5c4-ba8d-4b80-a235-beace0346305 req-fe171213-701c-4705-8cef-0fd7c4f16ecd service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] No waiting events found dispatching network-vif-plugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:21:58 user nova-compute[75293]: WARNING nova.compute.manager [req-6a47b5c4-ba8d-4b80-a235-beace0346305 req-fe171213-701c-4705-8cef-0fd7c4f16ecd service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Received unexpected event network-vif-plugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 for instance with vm_state building and task_state spawning.
Nov 30 07:21:58 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Instance spawned successfully.
Nov 30 07:21:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:21:58 user nova-compute[75293]: INFO nova.compute.manager [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 30 07:21:58 user nova-compute[75293]: DEBUG nova.compute.manager [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:58 user nova-compute[75293]: INFO nova.compute.manager [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Took 6.64 seconds to build instance.
Nov 30 07:21:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0f54441c-cdab-467a-ae33-1e67bdcf92c3 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "26b50488-cf81-4241-ade7-95044312ceba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.934s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.compute.manager [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:21:59 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Creating image(s)
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Did not create local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Ensure instance console log exists: /opt/stack/data/nova/instances/41791107-ce7b-4bab-888c-cb84618646d1/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Start _get_guest_xml network_info=[{"id": "3d00dd6e-5542-414d-8b35-fa40298b43af", "address": "fa:16:3e:9f:20:c2", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00dd6e-55", "ovs_interfaceid": "3d00dd6e-5542-414d-8b35-fa40298b43af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlKQZWip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '41791107-ce7b-4bab-888c-cb84618646d1', 'attached_at': '', 'detached_at': '', 'volume_id': '330c7b7e-b627-4aa6-af55-d715c3dc66dd', 'serial': '330c7b7e-b627-4aa6-af55-d715c3dc66dd'}, 'delete_on_termination': True, 'attachment_id': 'b4873205-9482-4de5-9948-0416034a764f', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:21:59 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:21:59 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlKQZWip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:21:59 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:21:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:21:59 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:21:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:21:59 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[26104e2f-b9a8-48a6-8730-5591b2894b1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:21:59 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5963f2-7175-4055-9664-204d67b439b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd] added
Nov 30 07:21:59 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dbe77a-bd24-4a5f-a547-014641a666c6]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b00f521-bc6d-4993-a29e-6f2619b64abe]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TlKQZWip {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TlKQZWip" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7201a1f3-be60-4d8f-95a7-66f6697aca80]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TlKQZWip'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:21:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e41d138-9bc0-480d-bfbd-bdeadcff4128]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c275a93-5f65-4094-9a39-1dcaea5732c4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:22:00 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:22:00 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b7343a-0170-4b56-a986-3fe8a1a5aadc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd, portal: 172.16.0.220,3260]
Nov 30 07:22:00 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd, portal: 172.16.0.220,3260] successful.
Nov 30 07:22:00 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ecbe38-6578-41f0-b620-479567f6cfad]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8556ecc5-d633-4627-b158-47373c3e18cc]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:22:00 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:22:00 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:22:00 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:22:00 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[badbef03-0e82-41aa-8df6-0e4feba5319f]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlKQZWip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23438386165343664', 'path': '/dev/sdb'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438386165343664', 'path': '/dev/sdb'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1689178154',display_name='tempest-TestVolumeBootPattern-server-1689178154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1689178154',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4bfa84ea3874ba7ac0af4c3b1d2f918',ramdisk_id='',reservation_id='r-eb42ikch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273596612',owner_user_name='tempest-TestVolumeBootPattern-273596612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:21:44Z,user_data=None,user_id='fbee62d1b15144cc9d433a4a64dd12a7',uuid=41791107-ce7b-4bab-888c-cb84618646d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d00dd6e-5542-414d-8b35-fa40298b43af", "address": "fa:16:3e:9f:20:c2", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00dd6e-55", "ovs_interfaceid": "3d00dd6e-5542-414d-8b35-fa40298b43af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converting VIF {"id": "3d00dd6e-5542-414d-8b35-fa40298b43af", "address": "fa:16:3e:9f:20:c2", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00dd6e-55", "ovs_interfaceid": "3d00dd6e-5542-414d-8b35-fa40298b43af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=3d00dd6e-5542-414d-8b35-fa40298b43af,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d00dd6e-55') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG nova.objects.instance [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lazy-loading 'pci_devices' on Instance uuid 41791107-ce7b-4bab-888c-cb84618646d1 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:22:01 user nova-compute[75293]:   <uuid>41791107-ce7b-4bab-888c-cb84618646d1</uuid>
Nov 30 07:22:01 user nova-compute[75293]:   <name>instance-00000024</name>
Nov 30 07:22:01 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:22:01 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:22:01 user nova-compute[75293]:   <metadata>
Nov 30 07:22:01 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:22:01 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:22:01 user nova-compute[75293]:       <nova:name>tempest-TestVolumeBootPattern-server-1689178154</nova:name>
Nov 30 07:22:01 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:21:59</nova:creationTime>
Nov 30 07:22:01 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:22:01 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:22:01 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:22:01 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:22:01 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:22:01 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:22:01 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:22:01 user nova-compute[75293]:       <nova:owner>
Nov 30 07:22:01 user nova-compute[75293]:         <nova:user uuid="fbee62d1b15144cc9d433a4a64dd12a7">tempest-TestVolumeBootPattern-273596612-project-member</nova:user>
Nov 30 07:22:01 user nova-compute[75293]:         <nova:project uuid="e4bfa84ea3874ba7ac0af4c3b1d2f918">tempest-TestVolumeBootPattern-273596612</nova:project>
Nov 30 07:22:01 user nova-compute[75293]:       </nova:owner>
Nov 30 07:22:01 user nova-compute[75293]:       <nova:ports>
Nov 30 07:22:01 user nova-compute[75293]:         <nova:port uuid="3d00dd6e-5542-414d-8b35-fa40298b43af">
Nov 30 07:22:01 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 07:22:01 user nova-compute[75293]:         </nova:port>
Nov 30 07:22:01 user nova-compute[75293]:       </nova:ports>
Nov 30 07:22:01 user nova-compute[75293]:     </nova:instance>
Nov 30 07:22:01 user nova-compute[75293]:   </metadata>
Nov 30 07:22:01 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:22:01 user nova-compute[75293]:     <system>
Nov 30 07:22:01 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:22:01 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:22:01 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:22:01 user nova-compute[75293]:       <entry name="serial">41791107-ce7b-4bab-888c-cb84618646d1</entry>
Nov 30 07:22:01 user nova-compute[75293]:       <entry name="uuid">41791107-ce7b-4bab-888c-cb84618646d1</entry>
Nov 30 07:22:01 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:22:01 user nova-compute[75293]:     </system>
Nov 30 07:22:01 user nova-compute[75293]:   </sysinfo>
Nov 30 07:22:01 user nova-compute[75293]:   <os>
Nov 30 07:22:01 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:22:01 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:22:01 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:22:01 user nova-compute[75293]:   </os>
Nov 30 07:22:01 user nova-compute[75293]:   <features>
Nov 30 07:22:01 user nova-compute[75293]:     <acpi/>
Nov 30 07:22:01 user nova-compute[75293]:     <apic/>
Nov 30 07:22:01 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:22:01 user nova-compute[75293]:   </features>
Nov 30 07:22:01 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:22:01 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:22:01 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:22:01 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:22:01 user nova-compute[75293]:   </clock>
Nov 30 07:22:01 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:22:01 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:22:01 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:22:01 user nova-compute[75293]:   </cpu>
Nov 30 07:22:01 user nova-compute[75293]:   <devices>
Nov 30 07:22:01 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:22:01 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:22:01 user nova-compute[75293]:       <source dev="/dev/sdb"/>
Nov 30 07:22:01 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:22:01 user nova-compute[75293]:       <serial>330c7b7e-b627-4aa6-af55-d715c3dc66dd</serial>
Nov 30 07:22:01 user nova-compute[75293]:     </disk>
Nov 30 07:22:01 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:22:01 user nova-compute[75293]:       <mac address="fa:16:3e:9f:20:c2"/>
Nov 30 07:22:01 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:22:01 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:22:01 user nova-compute[75293]:       <target dev="tap3d00dd6e-55"/>
Nov 30 07:22:01 user nova-compute[75293]:     </interface>
Nov 30 07:22:01 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:22:01 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/41791107-ce7b-4bab-888c-cb84618646d1/console.log" append="off"/>
Nov 30 07:22:01 user nova-compute[75293]:     </serial>
Nov 30 07:22:01 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:22:01 user nova-compute[75293]:     <video>
Nov 30 07:22:01 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:22:01 user nova-compute[75293]:     </video>
Nov 30 07:22:01 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:22:01 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:22:01 user nova-compute[75293]:     </rng>
Nov 30 07:22:01 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:22:01 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:22:01 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:22:01 user nova-compute[75293]:     </memballoon>
Nov 30 07:22:01 user nova-compute[75293]:   </devices>
Nov 30 07:22:01 user nova-compute[75293]: </domain>
Nov 30 07:22:01 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1689178154',display_name='tempest-TestVolumeBootPattern-server-1689178154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1689178154',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4bfa84ea3874ba7ac0af4c3b1d2f918',ramdisk_id='',reservation_id='r-eb42ikch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273596612',owner_user_name='tempest-TestVolumeBootPattern-273596612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:21:44Z,user_data=None,user_id='fbee62d1b15144cc9d433a4a64dd12a7',uuid=41791107-ce7b-4bab-888c-cb84618646d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d00dd6e-5542-414d-8b35-fa40298b43af", "address": "fa:16:3e:9f:20:c2", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00dd6e-55", "ovs_interfaceid": "3d00dd6e-5542-414d-8b35-fa40298b43af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converting VIF {"id": "3d00dd6e-5542-414d-8b35-fa40298b43af", "address": "fa:16:3e:9f:20:c2", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00dd6e-55", "ovs_interfaceid": "3d00dd6e-5542-414d-8b35-fa40298b43af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=3d00dd6e-5542-414d-8b35-fa40298b43af,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d00dd6e-55') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG os_vif [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=3d00dd6e-5542-414d-8b35-fa40298b43af,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d00dd6e-55') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc44e996-5fc3-5367-bc4b-40899ad33fc4', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d00dd6e-55, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d00dd6e-55, col_values=(('qos', UUID('51c95495-0913-49df-9451-8d7d90fc61d3')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d00dd6e-55, col_values=(('external_ids', {'iface-id': '3d00dd6e-5542-414d-8b35-fa40298b43af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:20:c2', 'vm-uuid': '41791107-ce7b-4bab-888c-cb84618646d1'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:01 user nova-compute[75293]: INFO os_vif [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=3d00dd6e-5542-414d-8b35-fa40298b43af,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d00dd6e-55')
Nov 30 07:22:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] No VIF found with MAC fa:16:3e:9f:20:c2, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:22:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:02 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:22:02 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:22:02 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=7903MB free_disk=25.046772003173828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance c8d1df78-2aa2-4710-a570-5f72c60cfc26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance ed037c80-4f33-4e03-907c-18b4ea122411 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 4ebf0be9-15e0-418c-a554-7885c79a725b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 54c60b45-04dc-4d3b-96ec-c2d0f583cafa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance d89452ef-96ab-4081-bc40-0f64968de367 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 41791107-ce7b-4bab-888c-cb84618646d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 26b50488-cf81-4241-ade7-95044312ceba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-cc2825c5-7098-4c66-9c1c-6dce29b60883 req-383bb5fa-d1cd-434f-bc93-b89c7372f4f5 service nova] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Received event network-vif-plugged-3d00dd6e-5542-414d-8b35-fa40298b43af {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:22:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cc2825c5-7098-4c66-9c1c-6dce29b60883 req-383bb5fa-d1cd-434f-bc93-b89c7372f4f5 service nova] Acquiring lock "41791107-ce7b-4bab-888c-cb84618646d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:22:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cc2825c5-7098-4c66-9c1c-6dce29b60883 req-383bb5fa-d1cd-434f-bc93-b89c7372f4f5 service nova] Lock "41791107-ce7b-4bab-888c-cb84618646d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:22:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cc2825c5-7098-4c66-9c1c-6dce29b60883 req-383bb5fa-d1cd-434f-bc93-b89c7372f4f5 service nova] Lock "41791107-ce7b-4bab-888c-cb84618646d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:22:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-cc2825c5-7098-4c66-9c1c-6dce29b60883 req-383bb5fa-d1cd-434f-bc93-b89c7372f4f5 service nova] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] No waiting events found dispatching network-vif-plugged-3d00dd6e-5542-414d-8b35-fa40298b43af {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:22:03 user nova-compute[75293]: WARNING nova.compute.manager [req-cc2825c5-7098-4c66-9c1c-6dce29b60883 req-383bb5fa-d1cd-434f-bc93-b89c7372f4f5 service nova] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Received unexpected event network-vif-plugged-3d00dd6e-5542-414d-8b35-fa40298b43af for instance with vm_state building and task_state spawning.
Nov 30 07:22:03 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:22:03 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:22:03 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:22:03 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:22:03 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:22:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:05 user nova-compute[75293]: DEBUG nova.compute.manager [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:22:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:22:05 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Instance spawned successfully.
Nov 30 07:22:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:22:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:22:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:22:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:22:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:22:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:22:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:22:05 user nova-compute[75293]: DEBUG nova.compute.manager [req-09c53916-4720-430f-97c3-1de3d94fbdac req-2aedb17f-fbfd-48b4-b807-a9c744b2a5fa service nova] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Received event network-vif-plugged-3d00dd6e-5542-414d-8b35-fa40298b43af {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:22:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-09c53916-4720-430f-97c3-1de3d94fbdac req-2aedb17f-fbfd-48b4-b807-a9c744b2a5fa service nova] Acquiring lock "41791107-ce7b-4bab-888c-cb84618646d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:22:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-09c53916-4720-430f-97c3-1de3d94fbdac req-2aedb17f-fbfd-48b4-b807-a9c744b2a5fa service nova] Lock "41791107-ce7b-4bab-888c-cb84618646d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:22:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-09c53916-4720-430f-97c3-1de3d94fbdac req-2aedb17f-fbfd-48b4-b807-a9c744b2a5fa service nova] Lock "41791107-ce7b-4bab-888c-cb84618646d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:22:05 user nova-compute[75293]: DEBUG nova.compute.manager [req-09c53916-4720-430f-97c3-1de3d94fbdac req-2aedb17f-fbfd-48b4-b807-a9c744b2a5fa service nova] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] No waiting events found dispatching network-vif-plugged-3d00dd6e-5542-414d-8b35-fa40298b43af {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:22:05 user nova-compute[75293]: WARNING nova.compute.manager [req-09c53916-4720-430f-97c3-1de3d94fbdac req-2aedb17f-fbfd-48b4-b807-a9c744b2a5fa service nova] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Received unexpected event network-vif-plugged-3d00dd6e-5542-414d-8b35-fa40298b43af for instance with vm_state building and task_state spawning.
Nov 30 07:22:05 user nova-compute[75293]: INFO nova.compute.manager [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 30 07:22:05 user nova-compute[75293]: DEBUG nova.compute.manager [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:22:05 user nova-compute[75293]: INFO nova.compute.manager [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Took 21.68 seconds to build instance.
Nov 30 07:22:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c5f8b58b-1a4a-4690-a08d-6253ec56096a tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "41791107-ce7b-4bab-888c-cb84618646d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.771s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:22:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:22:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:22:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:22:11 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lazy-loading 'flavor' on Instance uuid 4ebf0be9-15e0-418c-a554-7885c79a725b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:22:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:22:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:22:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:22:11 user nova-compute[75293]: INFO nova.compute.manager [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Attaching volume f94d1e8f-7884-4465-8d27-6d9c2f6348ec to /dev/vdb
Nov 30 07:22:11 user nova-compute[75293]: DEBUG os_brick.utils [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:22:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:11 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6240c87-0153-44a6-a3d0-49271369c25c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:12 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:12 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d37f079-d5cd-427a-99e7-b7fbf593183e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:12 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:12 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:12 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[538e89b3-640a-4203-a0a0-da41c6c044af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:12 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e895947-a142-4b3e-9c33-3c35d8b2dd3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:12 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:12 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:22:12 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:22:12 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:12 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:22:12 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:22:12 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17dbafd-6b00-45ea-8fa4-c1502c06bf70]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:12 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:22:12 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:22:12 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:22:12 user nova-compute[75293]: DEBUG os_brick.utils [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:22:12 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Updating existing volume attachment record: d58d8450-2b8b-4dfa-9871-65dbf1a98686 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG nova.compute.manager [req-2bfee46b-886e-4984-b242-2f2400238f08 req-3d7087a3-2ab5-4261-9046-cee30a424e4d service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Received event network-changed-546018e5-13f4-4368-abb5-a0cfa3355314 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG nova.compute.manager [req-2bfee46b-886e-4984-b242-2f2400238f08 req-3d7087a3-2ab5-4261-9046-cee30a424e4d service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Refreshing instance network info cache due to event network-changed-546018e5-13f4-4368-abb5-a0cfa3355314. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2bfee46b-886e-4984-b242-2f2400238f08 req-3d7087a3-2ab5-4261-9046-cee30a424e4d service nova] Acquiring lock "refresh_cache-ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2bfee46b-886e-4984-b242-2f2400238f08 req-3d7087a3-2ab5-4261-9046-cee30a424e4d service nova] Acquired lock "refresh_cache-ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG nova.network.neutron [req-2bfee46b-886e-4984-b242-2f2400238f08 req-3d7087a3-2ab5-4261-9046-cee30a424e4d service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Refreshing network info cache for port 546018e5-13f4-4368-abb5-a0cfa3355314 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG nova.objects.instance [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lazy-loading 'flavor' on Instance uuid ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:22:13 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Ignoring supplied device name: /dev/vdb
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG nova.network.neutron [req-2bfee46b-886e-4984-b242-2f2400238f08 req-3d7087a3-2ab5-4261-9046-cee30a424e4d service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Updated VIF entry in instance network info cache for port 546018e5-13f4-4368-abb5-a0cfa3355314. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG nova.network.neutron [req-2bfee46b-886e-4984-b242-2f2400238f08 req-3d7087a3-2ab5-4261-9046-cee30a424e4d service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Updating instance_info_cache with network_info: [{"id": "546018e5-13f4-4368-abb5-a0cfa3355314", "address": "fa:16:3e:c9:32:7a", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546018e5-13", "ovs_interfaceid": "546018e5-13f4-4368-abb5-a0cfa3355314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2bfee46b-886e-4984-b242-2f2400238f08 req-3d7087a3-2ab5-4261-9046-cee30a424e4d service nova] Releasing lock "refresh_cache-ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:22:13 user nova-compute[75293]: INFO nova.compute.manager [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Attaching volume b4302555-b1c6-479c-b0ed-9204437202f5 to /dev/vdb
Nov 30 07:22:13 user nova-compute[75293]: DEBUG os_brick.utils [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2a0a75-6cac-4d9e-92d3-d565d6b405a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdc0b97-ff4e-4a79-829a-63718ec09a17]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[22716c3e-383f-4793-bff7-ae2f3980dd03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bd001e-61fb-4bc0-90e0-4a7d50759081]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:22:13 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:22:13 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9577fb8d-ff2c-4f76-84ed-d85c700f1c00]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG os_brick.utils [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:22:13 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Updating existing volume attachment record: 7ba63f9b-3edf-4605-9eec-4282e0c60bb0 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:22:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UofmEetS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:22:24 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:22:24 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:22:24 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd868b3-5b60-4daa-bac8-b7d84c629260]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:22:24 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac437a3-4296-490a-862e-40f7dacd3381]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec] added
Nov 30 07:22:24 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1bee31-2597-4e9d-b80f-e40407fca714]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0af9c1e-6586-417d-8c02-c866988138d2]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UofmEetS {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UofmEetS" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89a0786-9b9d-46be-a437-76dbf33de340]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UofmEetS'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ab4c34-1cc7-4105-a673-40ee0c7d1d49]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f575d3-0388-42bd-90a4-4187eae92870]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:22:24 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:22:24 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:22:24 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:22:24 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[639c96fb-c974-470e-bd7d-fb73c91fd7c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec, portal: 172.16.0.220,3260]
Nov 30 07:22:24 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec, portal: 172.16.0.220,3260] successful.
Nov 30 07:22:24 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3714e211-8dcd-48dc-a317-00e12750abfa]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97ae27f-464c-498d-b41f-c8f98180ec34]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:22:24 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:22:24 user nova-compute[75293]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec (non-flash)
Nov 30 07:22:24 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:22:24 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:22:24 user nova-compute[75293]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec (non-flash)
Nov 30 07:22:24 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1f76b4-6428-41d8-91ab-cd1f7f1ecdbb]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:22:24 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UofmEetS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:22:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:22:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23163613830356332', 'path': '/dev/sdc'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:22:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163613830356332', 'path': '/dev/sdc'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:22:25 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lazy-loading 'flavor' on Instance uuid 4ebf0be9-15e0-418c-a554-7885c79a725b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:22:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:22:25 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:22:25 user nova-compute[75293]:   <source dev="/dev/sdc"/>
Nov 30 07:22:25 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:22:25 user nova-compute[75293]:   <serial>f94d1e8f-7884-4465-8d27-6d9c2f6348ec</serial>
Nov 30 07:22:25 user nova-compute[75293]: </disk>
Nov 30 07:22:25 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:22:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:22:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:22:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] No VIF found with MAC fa:16:3e:61:ea:d9, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b6d5225-1812-4a8e-9128-cb1466989493 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.370s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFZJYNbt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:22:26 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:22:26 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:22:26 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3f1d40-8ca4-4483-8dd0-55a141a2dadf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:22:26 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[807969c4-faa4-4eb4-bdc9-50ecdbd54e4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5] added
Nov 30 07:22:26 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad25edd-7103-4656-82aa-c52d2ca1faa6]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[53443550-2451-495a-a1a4-f34eb901b389]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFZJYNbt {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFZJYNbt" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1f4ac0-28ae-47c8-af5d-baa98d87ef0d]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KFZJYNbt'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad578ad-6476-459b-bf06-e9018aea42a4]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b8f61f-8934-42ef-80b6-52e77785143b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:22:26 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:22:26 user nova-compute[75293]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec (non-flash)
Nov 30 07:22:26 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:22:26 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:22:26 user nova-compute[75293]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec (non-flash)
Nov 30 07:22:26 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dcd27e-ebe4-4e41-835a-d99a465ecf73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5, portal: 172.16.0.220,3260]
Nov 30 07:22:26 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5, portal: 172.16.0.220,3260] successful.
Nov 30 07:22:26 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5eff0d-16ef-431b-927c-6ad03df51c13]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f45333-bfcb-4eca-85ae-b950fbec0b24]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:22:26 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:22:26 user nova-compute[75293]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec (non-flash)
Nov 30 07:22:26 user nova-compute[75293]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 (non-flash)
Nov 30 07:22:26 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:22:26 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:22:26 user nova-compute[75293]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec (non-flash)
Nov 30 07:22:26 user nova-compute[75293]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 (non-flash)
Nov 30 07:22:26 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a291fdda-0f66-467a-9111-00dea4bfe063]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:22:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFZJYNbt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:22:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:22:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26663326332656536', 'path': '/dev/sde'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:22:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663326332656536', 'path': '/dev/sde'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:22:27 user nova-compute[75293]: DEBUG nova.objects.instance [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lazy-loading 'flavor' on Instance uuid ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:22:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:22:27 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:22:27 user nova-compute[75293]:   <source dev="/dev/sde"/>
Nov 30 07:22:27 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:22:27 user nova-compute[75293]:   <serial>b4302555-b1c6-479c-b0ed-9204437202f5</serial>
Nov 30 07:22:27 user nova-compute[75293]: </disk>
Nov 30 07:22:27 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:22:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:22:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:22:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] No VIF found with MAC fa:16:3e:c9:32:7a, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:22:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a555fead-4d56-43f6-a579-cdbe2fa3f9c4 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.023s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:22:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:22:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:22:28 user nova-compute[75293]: INFO nova.compute.manager [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Detaching volume f94d1e8f-7884-4465-8d27-6d9c2f6348ec
Nov 30 07:22:28 user nova-compute[75293]: INFO nova.virt.block_device [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Attempting to driver detach volume f94d1e8f-7884-4465-8d27-6d9c2f6348ec from mountpoint /dev/vdb
Nov 30 07:22:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Attempting to detach device vdb from instance 4ebf0be9-15e0-418c-a554-7885c79a725b from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:22:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:22:29 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:22:29 user nova-compute[75293]:   <source dev="/dev/sdc"/>
Nov 30 07:22:29 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:22:29 user nova-compute[75293]:   <serial>f94d1e8f-7884-4465-8d27-6d9c2f6348ec</serial>
Nov 30 07:22:29 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:22:29 user nova-compute[75293]: </disk>
Nov 30 07:22:29 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:22:29 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Successfully detached device vdb from instance 4ebf0be9-15e0-418c-a554-7885c79a725b from the persistent domain config.
Nov 30 07:22:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4ebf0be9-15e0-418c-a554-7885c79a725b from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:22:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:22:29 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:22:29 user nova-compute[75293]:   <source dev="/dev/sdc"/>
Nov 30 07:22:29 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:22:29 user nova-compute[75293]:   <serial>f94d1e8f-7884-4465-8d27-6d9c2f6348ec</serial>
Nov 30 07:22:29 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:22:29 user nova-compute[75293]: </disk>
Nov 30 07:22:29 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:22:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4ebf0be9-15e0-418c-a554-7885c79a725b {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:22:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:22:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75293) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 07:22:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:22:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:22:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:45 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:22:45 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75293) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 07:22:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:22:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75293) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 07:22:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:22:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:22:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:49 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4ebf0be9-15e0-418c-a554-7885c79a725b is timed out.
Nov 30 07:22:49 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Successfully detached device vdb from instance 4ebf0be9-15e0-418c-a554-7885c79a725b from the live domain config.
Nov 30 07:22:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UofmEetS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:22:49 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22fa165-e1f6-44b0-b6b8-47c960b7615c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:22:49 user nova-compute[75293]: No targets found.
Nov 30 07:22:49 user nova-compute[75293]: iSNS:
Nov 30 07:22:49 user nova-compute[75293]: No targets found.
Nov 30 07:22:49 user nova-compute[75293]: STATIC:
Nov 30 07:22:49 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd
Nov 30 07:22:49 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:22:49 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:22:49 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5
Nov 30 07:22:49 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:22:49 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:22:49 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:22:49 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:22:49 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:22:49 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec
Nov 30 07:22:49 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:22:49 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:22:49 user nova-compute[75293]: FIRMWARE:
Nov 30 07:22:49 user nova-compute[75293]: No targets found.
Nov 30 07:22:49 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:22:49 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:22:49 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b01312-d7bc-4221-b8b9-5bbd113b765d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a7cb95-9019-4b3c-bce6-4eeecd3dae8f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:22:49 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:22:49 user nova-compute[75293]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec (non-flash)
Nov 30 07:22:49 user nova-compute[75293]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 (non-flash)
Nov 30 07:22:49 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:22:49 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:22:49 user nova-compute[75293]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec (non-flash)
Nov 30 07:22:49 user nova-compute[75293]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 (non-flash)
Nov 30 07:22:49 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe82aadd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec'): ({'sdc'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Removing single pathed devices sdc {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[361c53ea-9ff5-4223-9fb0-406ffab26b25]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48871ce-1fe0-4aef-9ff2-9be58d5ef9e3]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Flushing IO for device /dev/sdc {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12e6b6e-3f90-4e70-a4fc-ab75879cd168]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf50c1e-6cdb-4198-ad62-082d7c9689ff]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7d2dfe-1ff3-4ec9-9fa1-2d5990ffb36a]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6e68d3-d51d-4cfc-9ca8-c6894199cf7b]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec, portal: 172.16.0.220,3260]
Nov 30 07:22:49 user nova-compute[75293]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec, portal: 172.16.0.220,3260] successful.
Nov 30 07:22:49 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94d1e8f-7884-4465-8d27-6d9c2f6348ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f951e7-24b9-4bb0-adc6-3aa76b948cb7]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] <== disconnect_volume: return (322ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:22:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:22:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:53 user nova-compute[75293]: DEBUG nova.compute.manager [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:22:53 user nova-compute[75293]: INFO nova.compute.manager [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] instance snapshotting
Nov 30 07:22:53 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Beginning live snapshot process
Nov 30 07:22:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json -f qcow2 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json -f qcow2" returned: 0 in 0.207s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json -f qcow2 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:53 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lazy-loading 'flavor' on Instance uuid 4ebf0be9-15e0-418c-a554-7885c79a725b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:22:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8dd33ea5-a37c-49b7-b1eb-589a31de5dec tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.092s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:22:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.471s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuunsqwup/f08e21876d4248f2bcc7a94076003a68.delta 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:22:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:22:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuunsqwup/f08e21876d4248f2bcc7a94076003a68.delta 1073741824" returned: 0 in 0.067s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:54 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 30 07:22:54 user nova-compute[75293]: INFO nova.compute.manager [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Detaching volume b4302555-b1c6-479c-b0ed-9204437202f5
Nov 30 07:22:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:22:54 user nova-compute[75293]: INFO nova.virt.block_device [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Attempting to driver detach volume b4302555-b1c6-479c-b0ed-9204437202f5 from mountpoint /dev/vdb
Nov 30 07:22:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Attempting to detach device vdb from instance ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8 from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:22:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:22:54 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:22:54 user nova-compute[75293]:   <source dev="/dev/sde"/>
Nov 30 07:22:54 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:22:54 user nova-compute[75293]:   <serial>b4302555-b1c6-479c-b0ed-9204437202f5</serial>
Nov 30 07:22:54 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:22:54 user nova-compute[75293]: </disk>
Nov 30 07:22:54 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:22:54 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Successfully detached device vdb from instance ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8 from the persistent domain config.
Nov 30 07:22:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8 from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:22:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:22:54 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:22:54 user nova-compute[75293]:   <source dev="/dev/sde"/>
Nov 30 07:22:54 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:22:54 user nova-compute[75293]:   <serial>b4302555-b1c6-479c-b0ed-9204437202f5</serial>
Nov 30 07:22:54 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:22:54 user nova-compute[75293]: </disk>
Nov 30 07:22:54 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:22:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:22:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8 {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:22:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75293) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 30 07:22:55 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 30 07:22:55 user nova-compute[75293]: DEBUG nova.privsep.utils [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75293) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 07:22:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuunsqwup/f08e21876d4248f2bcc7a94076003a68.delta /opt/stack/data/nova/instances/snapshots/tmpuunsqwup/f08e21876d4248f2bcc7a94076003a68 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:55 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:22:55 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Cleaning up deleted instances {{(pid=75293) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 07:22:55 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] There are 0 instances to clean {{(pid=75293) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 07:22:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuunsqwup/f08e21876d4248f2bcc7a94076003a68.delta /opt/stack/data/nova/instances/snapshots/tmpuunsqwup/f08e21876d4248f2bcc7a94076003a68" returned: 0 in 0.533s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:56 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Snapshot extracted, beginning image upload
Nov 30 07:22:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:22:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75293) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 07:22:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:22:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:22:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:22:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:22:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:22:56 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:22:57 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:22:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:22:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:22:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:22:57 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:22:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:58 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Snapshot image upload complete
Nov 30 07:22:58 user nova-compute[75293]: INFO nova.compute.manager [None req-eafd8f1e-cfc9-4d09-96a2-354f3931e964 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Took 5.38 seconds to snapshot the instance on the hypervisor.
Nov 30 07:22:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:22:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:22:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:22:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:22:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:00 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:23:00 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:23:00 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=7789MB free_disk=24.937480926513672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:23:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance c8d1df78-2aa2-4710-a570-5f72c60cfc26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance ed037c80-4f33-4e03-907c-18b4ea122411 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 4ebf0be9-15e0-418c-a554-7885c79a725b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 54c60b45-04dc-4d3b-96ec-c2d0f583cafa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance d89452ef-96ab-4081-bc40-0f64968de367 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 41791107-ce7b-4bab-888c-cb84618646d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 26b50488-cf81-4241-ade7-95044312ceba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Refreshing inventories for resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Updating ProviderTree inventory for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Updating inventory in ProviderTree for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Refreshing aggregate associations for resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa, aggregates: None {{(pid=75293) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Refreshing trait associations for resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV {{(pid=75293) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:23:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.707s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:03 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:23:03 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:23:03 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:23:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:23:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:23:03 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:23:04 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Updating instance_info_cache with network_info: [{"id": "094f0848-c129-4499-8781-6943982188b6", "address": "fa:16:3e:44:2f:52", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094f0848-c1", "ovs_interfaceid": "094f0848-c129-4499-8781-6943982188b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:23:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:23:04 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:23:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:23:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:23:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:23:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:23:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:23:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:23:06 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:23:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:23:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75293) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 07:23:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:23:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:23:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:23:15 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8 is timed out.
Nov 30 07:23:15 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Successfully detached device vdb from instance ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8 from the live domain config.
Nov 30 07:23:15 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFZJYNbt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:23:15 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb2c888-d60f-48e4-8363-617e21721c85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:23:15 user nova-compute[75293]: No targets found.
Nov 30 07:23:15 user nova-compute[75293]: iSNS:
Nov 30 07:23:15 user nova-compute[75293]: No targets found.
Nov 30 07:23:15 user nova-compute[75293]: STATIC:
Nov 30 07:23:15 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd
Nov 30 07:23:15 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:23:15 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:23:15 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5
Nov 30 07:23:15 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:23:15 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:23:15 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:23:15 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:23:15 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:23:15 user nova-compute[75293]: FIRMWARE:
Nov 30 07:23:15 user nova-compute[75293]: No targets found.
Nov 30 07:23:15 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:23:15 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:23:15 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[501e5206-4cf7-4bef-92f8-b501ed66c400]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8b03dc-0bec-4353-a3d3-33d178d3045c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:23:15 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:23:15 user nova-compute[75293]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 (non-flash)
Nov 30 07:23:15 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:23:15 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:23:15 user nova-compute[75293]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 (non-flash)
Nov 30 07:23:15 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe0363c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5'): ({'sde'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Removing single pathed devices sde {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bd6363-21f7-4192-a53c-0fd156113560]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1114674c-1753-409b-8eb2-24499098b85e]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Flushing IO for device /dev/sde {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee57d4c-77bb-4808-9abd-2ae8b7ffd7e5]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c811e4e-483c-4e64-99f4-7592ebdec0b0]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] SCSI volumes sde have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5a8551-2569-4131-bd70-6046656d0c68]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c62759-8074-437c-8adb-144e9c3753e7]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5, portal: 172.16.0.220,3260]
Nov 30 07:23:15 user nova-compute[75293]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5, portal: 172.16.0.220,3260] successful.
Nov 30 07:23:15 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[490f0b80-83c3-41cc-86c3-dc55eaec2f3a]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] <== disconnect_volume: return (280ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:23:15 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:23:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:16 user nova-compute[75293]: DEBUG nova.objects.instance [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lazy-loading 'flavor' on Instance uuid ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:23:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-116f4d39-64ac-4ce5-a41e-f60403328eed tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.165s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.083s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:16 user nova-compute[75293]: INFO nova.compute.manager [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Terminating instance
Nov 30 07:23:16 user nova-compute[75293]: DEBUG nova.compute.manager [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:23:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-68428797-a727-49cf-b6e0-57bc5d55ca4b req-7aedddae-20c3-421d-979d-8c5fdbd3552c service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Received event network-vif-unplugged-546018e5-13f4-4368-abb5-a0cfa3355314 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-68428797-a727-49cf-b6e0-57bc5d55ca4b req-7aedddae-20c3-421d-979d-8c5fdbd3552c service nova] Acquiring lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-68428797-a727-49cf-b6e0-57bc5d55ca4b req-7aedddae-20c3-421d-979d-8c5fdbd3552c service nova] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-68428797-a727-49cf-b6e0-57bc5d55ca4b req-7aedddae-20c3-421d-979d-8c5fdbd3552c service nova] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-68428797-a727-49cf-b6e0-57bc5d55ca4b req-7aedddae-20c3-421d-979d-8c5fdbd3552c service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] No waiting events found dispatching network-vif-unplugged-546018e5-13f4-4368-abb5-a0cfa3355314 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-68428797-a727-49cf-b6e0-57bc5d55ca4b req-7aedddae-20c3-421d-979d-8c5fdbd3552c service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Received event network-vif-unplugged-546018e5-13f4-4368-abb5-a0cfa3355314 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:23:17 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Instance destroyed successfully.
Nov 30 07:23:17 user nova-compute[75293]: DEBUG nova.objects.instance [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lazy-loading 'resources' on Instance uuid ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:20:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1273885825',display_name='tempest-VolumesSnapshotTestJSON-instance-1273885825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1273885825',id=33,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaWu44EGhs7xcoiw5q03sxrrzvJRo4GX+UML37DFSPQmFWvLM0Uf+j9hq7MrpTyrS749yQFC6dfIJvlEqtXxTh968GJ+A0LTOaQ34u61ffMDjpXetYAMOESGNoLb1sUfQ==',key_name='tempest-keypair-1921930209',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:20:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f979cf6621554018bbb90c09afd87c5a',ramdisk_id='',reservation_id='r-rp2pb4qn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-73863621',owner_user_name='tempest-VolumesSnapshotTestJSON-73863621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:20:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a86d36e3fa88466d9a047e9370468ecc',uuid=ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "546018e5-13f4-4368-abb5-a0cfa3355314", "address": "fa:16:3e:c9:32:7a", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546018e5-13", "ovs_interfaceid": "546018e5-13f4-4368-abb5-a0cfa3355314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Converting VIF {"id": "546018e5-13f4-4368-abb5-a0cfa3355314", "address": "fa:16:3e:c9:32:7a", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap546018e5-13", "ovs_interfaceid": "546018e5-13f4-4368-abb5-a0cfa3355314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:32:7a,bridge_name='br-int',has_traffic_filtering=True,id=546018e5-13f4-4368-abb5-a0cfa3355314,network=Network(0f103825-2792-47bf-b5e2-1108396c6212),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap546018e5-13') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG os_vif [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:32:7a,bridge_name='br-int',has_traffic_filtering=True,id=546018e5-13f4-4368-abb5-a0cfa3355314,network=Network(0f103825-2792-47bf-b5e2-1108396c6212),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap546018e5-13') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap546018e5-13, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d13cb472-01f6-4556-8e95-afa334ea0e8c) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:17 user nova-compute[75293]: INFO os_vif [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:32:7a,bridge_name='br-int',has_traffic_filtering=True,id=546018e5-13f4-4368-abb5-a0cfa3355314,network=Network(0f103825-2792-47bf-b5e2-1108396c6212),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap546018e5-13')
Nov 30 07:23:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFZJYNbt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:23:17 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:23:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1d7c65-da17-4d00-bd36-d147cbd7908e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:23:17 user nova-compute[75293]: No targets found.
Nov 30 07:23:17 user nova-compute[75293]: iSNS:
Nov 30 07:23:17 user nova-compute[75293]: No targets found.
Nov 30 07:23:17 user nova-compute[75293]: STATIC:
Nov 30 07:23:17 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd
Nov 30 07:23:17 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:23:17 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:23:17 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:23:17 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:23:17 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:23:17 user nova-compute[75293]: FIRMWARE:
Nov 30 07:23:17 user nova-compute[75293]: No targets found.
Nov 30 07:23:17 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:23:17 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:23:17 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4302555-b1c6-479c-b0ed-9204437202f5', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[978ac5cc-2453-4d8d-91db-0ada4d9db8c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c37454-11b6-4fef-9636-547b34e9e8e1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:23:17 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:23:17 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:23:17 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:23:17 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe83d6b90>, {}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Disconnecting from: [] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] <== disconnect_volume: return (77ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:23:17 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Deleting instance files /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8_del
Nov 30 07:23:17 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Deletion of /opt/stack/data/nova/instances/ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8_del complete
Nov 30 07:23:17 user nova-compute[75293]: INFO nova.compute.manager [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 30 07:23:17 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:23:17 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:23:18 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:23:18 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Took 0.97 seconds to deallocate network for instance.
Nov 30 07:23:18 user nova-compute[75293]: WARNING nova.volume.cinder [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Attachment 7ba63f9b-3edf-4605-9eec-4282e0c60bb0 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7ba63f9b-3edf-4605-9eec-4282e0c60bb0. (HTTP 404) (Request-ID: req-46c5b02b-4640-41c7-bf83-03239b5ee7e5)
Nov 30 07:23:18 user nova-compute[75293]: INFO nova.compute.manager [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Took 0.03 seconds to detach 1 volumes for instance.
Nov 30 07:23:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:18 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:23:18 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:23:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:18 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Deleted allocations for instance ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8
Nov 30 07:23:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fc994b6c-fec3-422a-8daa-b938b0dd3c4f tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.420s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:19 user nova-compute[75293]: DEBUG nova.compute.manager [req-20419585-03a5-4bf8-b957-160bde2dda3a req-11b1098f-e049-4a77-b6a6-76a5d6a77c36 service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Received event network-vif-plugged-546018e5-13f4-4368-abb5-a0cfa3355314 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:23:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-20419585-03a5-4bf8-b957-160bde2dda3a req-11b1098f-e049-4a77-b6a6-76a5d6a77c36 service nova] Acquiring lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-20419585-03a5-4bf8-b957-160bde2dda3a req-11b1098f-e049-4a77-b6a6-76a5d6a77c36 service nova] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-20419585-03a5-4bf8-b957-160bde2dda3a req-11b1098f-e049-4a77-b6a6-76a5d6a77c36 service nova] Lock "ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:19 user nova-compute[75293]: DEBUG nova.compute.manager [req-20419585-03a5-4bf8-b957-160bde2dda3a req-11b1098f-e049-4a77-b6a6-76a5d6a77c36 service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] No waiting events found dispatching network-vif-plugged-546018e5-13f4-4368-abb5-a0cfa3355314 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:23:19 user nova-compute[75293]: WARNING nova.compute.manager [req-20419585-03a5-4bf8-b957-160bde2dda3a req-11b1098f-e049-4a77-b6a6-76a5d6a77c36 service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Received unexpected event network-vif-plugged-546018e5-13f4-4368-abb5-a0cfa3355314 for instance with vm_state deleted and task_state None.
Nov 30 07:23:19 user nova-compute[75293]: DEBUG nova.compute.manager [req-20419585-03a5-4bf8-b957-160bde2dda3a req-11b1098f-e049-4a77-b6a6-76a5d6a77c36 service nova] [instance: ba678f4e-ab8e-4a76-aa1c-7c0d99b4a3c8] Received event network-vif-deleted-546018e5-13f4-4368-abb5-a0cfa3355314 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:23:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:21 user nova-compute[75293]: DEBUG nova.objects.instance [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lazy-loading 'flavor' on Instance uuid 4ebf0be9-15e0-418c-a554-7885c79a725b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:22 user nova-compute[75293]: INFO nova.compute.manager [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Attaching volume bb3492db-bd54-4367-82ef-e810cc2aa892 to /dev/vdb
Nov 30 07:23:22 user nova-compute[75293]: DEBUG os_brick.utils [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0837825-1d5d-42df-b825-665c6ad247e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[26631b8e-8113-4be0-be3a-2fcb61a4299f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[41422b80-c5e6-45af-8d06-31582ca84ff2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f672f6-5a19-429f-9d66-ab1bec2980d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:23:22 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:23:22 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1828c920-89bd-4e6b-b35a-e2c8aa866572]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG os_brick.utils [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:23:22 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Updating existing volume attachment record: e601b399-9de6-427d-b8cd-b3624ac6ccbd {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:23:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UZIfGQAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:23:30 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:23:30 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:23:30 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4717a835-91f4-48bf-b225-9a64bf815a82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:23:30 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7939a70-dad1-4a98-9c97-50042ca75271]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892] added
Nov 30 07:23:30 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aa1dd8-f124-4fc3-ad7b-3fadada8be3b]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[749f356a-664c-42ac-96da-1587ee31cca7]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UZIfGQAS {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UZIfGQAS" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78a3b38-b829-49a4-863b-0e711ce6eb8b]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UZIfGQAS'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f1fe03-fb1f-4755-bbce-6fc5aa6d2517]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f28307a-8090-471b-b60d-42a4a9cfce7f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:23:30 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:23:30 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:23:30 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:23:30 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e120d797-82b1-419a-b5d8-210262fff7ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892, portal: 172.16.0.220,3260]
Nov 30 07:23:30 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892, portal: 172.16.0.220,3260] successful.
Nov 30 07:23:30 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf4c8b5-23a0-4e7e-b259-0a10c84dc0ef]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8193de59-ab8e-4759-8954-186eaf00c0fc]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:23:30 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:23:30 user nova-compute[75293]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 (non-flash)
Nov 30 07:23:30 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:23:30 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:23:30 user nova-compute[75293]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 (non-flash)
Nov 30 07:23:30 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d274ba7-8dd7-4091-a83a-14dbf361ba57]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:30 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: None {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:23:31 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:23:31 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UZIfGQAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:23:31 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:23:31 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26463666162303238', 'path': '/dev/sdc'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:23:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463666162303238', 'path': '/dev/sdc'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:23:31 user nova-compute[75293]: DEBUG nova.objects.instance [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lazy-loading 'flavor' on Instance uuid 4ebf0be9-15e0-418c-a554-7885c79a725b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:23:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:23:31 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:23:31 user nova-compute[75293]:   <source dev="/dev/sdc"/>
Nov 30 07:23:31 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:23:31 user nova-compute[75293]:   <serial>bb3492db-bd54-4367-82ef-e810cc2aa892</serial>
Nov 30 07:23:31 user nova-compute[75293]: </disk>
Nov 30 07:23:31 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:23:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:23:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:23:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] No VIF found with MAC fa:16:3e:61:ea:d9, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:23:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-30c63f18-7aa7-4e1a-a875-7ff70f2a2813 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.032s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-5eb15667-c2bf-44cc-bcbb-c004d905605f req-7a7831aa-ebb0-4618-9a53-4d3b1ea50de4 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received event network-changed-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:23:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-5eb15667-c2bf-44cc-bcbb-c004d905605f req-7a7831aa-ebb0-4618-9a53-4d3b1ea50de4 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Refreshing instance network info cache due to event network-changed-0b9bbab7-780f-4b09-9c9b-4448e8ff2323. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:23:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5eb15667-c2bf-44cc-bcbb-c004d905605f req-7a7831aa-ebb0-4618-9a53-4d3b1ea50de4 service nova] Acquiring lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:23:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5eb15667-c2bf-44cc-bcbb-c004d905605f req-7a7831aa-ebb0-4618-9a53-4d3b1ea50de4 service nova] Acquired lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:23:32 user nova-compute[75293]: DEBUG nova.network.neutron [req-5eb15667-c2bf-44cc-bcbb-c004d905605f req-7a7831aa-ebb0-4618-9a53-4d3b1ea50de4 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Refreshing network info cache for port 0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:23:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:23:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75293) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 07:23:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:23:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:23:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:32 user nova-compute[75293]: DEBUG nova.network.neutron [req-5eb15667-c2bf-44cc-bcbb-c004d905605f req-7a7831aa-ebb0-4618-9a53-4d3b1ea50de4 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Updated VIF entry in instance network info cache for port 0b9bbab7-780f-4b09-9c9b-4448e8ff2323. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:23:32 user nova-compute[75293]: DEBUG nova.network.neutron [req-5eb15667-c2bf-44cc-bcbb-c004d905605f req-7a7831aa-ebb0-4618-9a53-4d3b1ea50de4 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Updating instance_info_cache with network_info: [{"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:23:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5eb15667-c2bf-44cc-bcbb-c004d905605f req-7a7831aa-ebb0-4618-9a53-4d3b1ea50de4 service nova] Releasing lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "41791107-ce7b-4bab-888c-cb84618646d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "41791107-ce7b-4bab-888c-cb84618646d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "41791107-ce7b-4bab-888c-cb84618646d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "41791107-ce7b-4bab-888c-cb84618646d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "41791107-ce7b-4bab-888c-cb84618646d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:34 user nova-compute[75293]: INFO nova.compute.manager [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Terminating instance
Nov 30 07:23:34 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG nova.compute.manager [req-05044f85-fa06-43bb-87d4-041813f289a9 req-26a3403d-e26e-4eb9-a52b-cf43e62eaa3d service nova] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Received event network-vif-unplugged-3d00dd6e-5542-414d-8b35-fa40298b43af {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-05044f85-fa06-43bb-87d4-041813f289a9 req-26a3403d-e26e-4eb9-a52b-cf43e62eaa3d service nova] Acquiring lock "41791107-ce7b-4bab-888c-cb84618646d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-05044f85-fa06-43bb-87d4-041813f289a9 req-26a3403d-e26e-4eb9-a52b-cf43e62eaa3d service nova] Lock "41791107-ce7b-4bab-888c-cb84618646d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-05044f85-fa06-43bb-87d4-041813f289a9 req-26a3403d-e26e-4eb9-a52b-cf43e62eaa3d service nova] Lock "41791107-ce7b-4bab-888c-cb84618646d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG nova.compute.manager [req-05044f85-fa06-43bb-87d4-041813f289a9 req-26a3403d-e26e-4eb9-a52b-cf43e62eaa3d service nova] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] No waiting events found dispatching network-vif-unplugged-3d00dd6e-5542-414d-8b35-fa40298b43af {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG nova.compute.manager [req-05044f85-fa06-43bb-87d4-041813f289a9 req-26a3403d-e26e-4eb9-a52b-cf43e62eaa3d service nova] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Received event network-vif-unplugged-3d00dd6e-5542-414d-8b35-fa40298b43af for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:34 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Instance destroyed successfully.
Nov 30 07:23:34 user nova-compute[75293]: DEBUG nova.objects.instance [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lazy-loading 'resources' on Instance uuid 41791107-ce7b-4bab-888c-cb84618646d1 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:23:34 user nova-compute[75293]: INFO nova.compute.manager [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Detaching volume bb3492db-bd54-4367-82ef-e810cc2aa892
Nov 30 07:23:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1689178154',display_name='tempest-TestVolumeBootPattern-server-1689178154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1689178154',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:22:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4bfa84ea3874ba7ac0af4c3b1d2f918',ramdisk_id='',reservation_id='r-eb42ikch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-273596612',owner_user_name='tempest-TestVolumeBootPattern-273596612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:22:05Z,user_data=None,user_id='fbee62d1b15144cc9d433a4a64dd12a7',uuid=41791107-ce7b-4bab-888c-cb84618646d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d00dd6e-5542-414d-8b35-fa40298b43af", "address": "fa:16:3e:9f:20:c2", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00dd6e-55", "ovs_interfaceid": "3d00dd6e-5542-414d-8b35-fa40298b43af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converting VIF {"id": "3d00dd6e-5542-414d-8b35-fa40298b43af", "address": "fa:16:3e:9f:20:c2", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00dd6e-55", "ovs_interfaceid": "3d00dd6e-5542-414d-8b35-fa40298b43af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=3d00dd6e-5542-414d-8b35-fa40298b43af,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d00dd6e-55') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG os_vif [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=3d00dd6e-5542-414d-8b35-fa40298b43af,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d00dd6e-55') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d00dd6e-55, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51c95495-0913-49df-9451-8d7d90fc61d3) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:35 user nova-compute[75293]: INFO os_vif [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:20:c2,bridge_name='br-int',has_traffic_filtering=True,id=3d00dd6e-5542-414d-8b35-fa40298b43af,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d00dd6e-55')
Nov 30 07:23:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TlKQZWip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:23:35 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7094765d-d135-4f82-8f13-aab83b43fdd0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:23:35 user nova-compute[75293]: No targets found.
Nov 30 07:23:35 user nova-compute[75293]: iSNS:
Nov 30 07:23:35 user nova-compute[75293]: No targets found.
Nov 30 07:23:35 user nova-compute[75293]: STATIC:
Nov 30 07:23:35 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd
Nov 30 07:23:35 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:23:35 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:23:35 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:23:35 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:23:35 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:23:35 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892
Nov 30 07:23:35 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:23:35 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:23:35 user nova-compute[75293]: FIRMWARE:
Nov 30 07:23:35 user nova-compute[75293]: No targets found.
Nov 30 07:23:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:23:35 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:23:35 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:35 user nova-compute[75293]: INFO nova.virt.block_device [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Attempting to driver detach volume bb3492db-bd54-4367-82ef-e810cc2aa892 from mountpoint /dev/vdb
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c93ebe5-a3ba-410a-8695-9712f1c8dd4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Attempting to detach device vdb from instance 4ebf0be9-15e0-418c-a554-7885c79a725b from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:23:35 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:23:35 user nova-compute[75293]:   <source dev="/dev/sdc"/>
Nov 30 07:23:35 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:23:35 user nova-compute[75293]:   <serial>bb3492db-bd54-4367-82ef-e810cc2aa892</serial>
Nov 30 07:23:35 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:23:35 user nova-compute[75293]: </disk>
Nov 30 07:23:35 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:23:35 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Successfully detached device vdb from instance 4ebf0be9-15e0-418c-a554-7885c79a725b from the persistent domain config.
Nov 30 07:23:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4ebf0be9-15e0-418c-a554-7885c79a725b from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:23:35 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:23:35 user nova-compute[75293]:   <source dev="/dev/sdc"/>
Nov 30 07:23:35 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:23:35 user nova-compute[75293]:   <serial>bb3492db-bd54-4367-82ef-e810cc2aa892</serial>
Nov 30 07:23:35 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:23:35 user nova-compute[75293]: </disk>
Nov 30 07:23:35 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5198c2-e226-4ed9-abab-89050337178a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:23:35 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:23:35 user nova-compute[75293]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 (non-flash)
Nov 30 07:23:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:23:35 user nova-compute[75293]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd (non-flash)
Nov 30 07:23:35 user nova-compute[75293]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 (non-flash)
Nov 30 07:23:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe01649d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd'): ({'sdb'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Removing single pathed devices sdb {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9d2f75-efc1-4c18-9da7-88e3943eaedb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff8af20-4d39-4cfc-8407-b93709973e0b]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Flushing IO for device /dev/sdb {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75835b2-2759-4921-a343-8fb7ea7c435f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d57fd53-c3b9-419c-a03e-ba66077bd678]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOdb321aa9-488ae46d22bcaec9', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_db321aa9', '/dev/disk/by-id/scsi-23438386165343664') {{(pid=86417) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e4cc06-1545-40f1-b4a6-25cec8fd05f6]: (4, None) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[be38a11e-c2a9-4264-8276-ea764e555ed1]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e949174d-13bc-4784-ac3a-89e612c113a3]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd, portal: 172.16.0.220,3260]
Nov 30 07:23:35 user nova-compute[75293]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd, portal: 172.16.0.220,3260] successful.
Nov 30 07:23:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330c7b7e-b627-4aa6-af55-d715c3dc66dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1ac735-f50c-4e8d-8e41-e60709d94acf]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] <== disconnect_volume: return (308ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:23:35 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Deleting instance files /opt/stack/data/nova/instances/41791107-ce7b-4bab-888c-cb84618646d1_del
Nov 30 07:23:35 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Deletion of /opt/stack/data/nova/instances/41791107-ce7b-4bab-888c-cb84618646d1_del complete
Nov 30 07:23:35 user nova-compute[75293]: INFO nova.compute.manager [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 30 07:23:35 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:23:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4ebf0be9-15e0-418c-a554-7885c79a725b {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:23:36 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:23:36 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Took 0.81 seconds to deallocate network for instance.
Nov 30 07:23:36 user nova-compute[75293]: DEBUG nova.compute.manager [req-e14d0a1b-bf62-4d33-8931-f66ea851df5d req-4cf6d657-2ae8-4f51-93b4-cdf9768664b2 service nova] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Received event network-vif-deleted-3d00dd6e-5542-414d-8b35-fa40298b43af {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:23:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:36 user nova-compute[75293]: DEBUG nova.compute.manager [req-71391662-aecc-4152-8655-fd92f8091f15 req-17952f49-6fd6-4798-a395-4856a6ade90b service nova] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Received event network-vif-plugged-3d00dd6e-5542-414d-8b35-fa40298b43af {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:23:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-71391662-aecc-4152-8655-fd92f8091f15 req-17952f49-6fd6-4798-a395-4856a6ade90b service nova] Acquiring lock "41791107-ce7b-4bab-888c-cb84618646d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-71391662-aecc-4152-8655-fd92f8091f15 req-17952f49-6fd6-4798-a395-4856a6ade90b service nova] Lock "41791107-ce7b-4bab-888c-cb84618646d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-71391662-aecc-4152-8655-fd92f8091f15 req-17952f49-6fd6-4798-a395-4856a6ade90b service nova] Lock "41791107-ce7b-4bab-888c-cb84618646d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:36 user nova-compute[75293]: DEBUG nova.compute.manager [req-71391662-aecc-4152-8655-fd92f8091f15 req-17952f49-6fd6-4798-a395-4856a6ade90b service nova] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] No waiting events found dispatching network-vif-plugged-3d00dd6e-5542-414d-8b35-fa40298b43af {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:23:36 user nova-compute[75293]: WARNING nova.compute.manager [req-71391662-aecc-4152-8655-fd92f8091f15 req-17952f49-6fd6-4798-a395-4856a6ade90b service nova] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Received unexpected event network-vif-plugged-3d00dd6e-5542-414d-8b35-fa40298b43af for instance with vm_state active and task_state deleting.
Nov 30 07:23:37 user nova-compute[75293]: INFO nova.compute.manager [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Took 0.80 seconds to detach 1 volumes for instance.
Nov 30 07:23:37 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 41791107-ce7b-4bab-888c-cb84618646d1] Deleting volume: 330c7b7e-b627-4aa6-af55-d715c3dc66dd {{(pid=75293) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 07:23:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:37 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:23:37 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:23:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:37 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Deleted allocations for instance 41791107-ce7b-4bab-888c-cb84618646d1
Nov 30 07:23:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6b1816f3-a040-41b9-912d-7713ee98cc19 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "41791107-ce7b-4bab-888c-cb84618646d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.309s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG nova.compute.manager [req-1fb6fc7d-b767-4668-9e22-292eca3a6818 req-9192f92b-9dd6-4b41-972c-e2a82a0136eb service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Received event network-changed-5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG nova.compute.manager [req-1fb6fc7d-b767-4668-9e22-292eca3a6818 req-9192f92b-9dd6-4b41-972c-e2a82a0136eb service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Refreshing instance network info cache due to event network-changed-5f826266-d1bb-4ef6-add4-41a7fb145fe4. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1fb6fc7d-b767-4668-9e22-292eca3a6818 req-9192f92b-9dd6-4b41-972c-e2a82a0136eb service nova] Acquiring lock "refresh_cache-26b50488-cf81-4241-ade7-95044312ceba" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1fb6fc7d-b767-4668-9e22-292eca3a6818 req-9192f92b-9dd6-4b41-972c-e2a82a0136eb service nova] Acquired lock "refresh_cache-26b50488-cf81-4241-ade7-95044312ceba" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG nova.network.neutron [req-1fb6fc7d-b767-4668-9e22-292eca3a6818 req-9192f92b-9dd6-4b41-972c-e2a82a0136eb service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Refreshing network info cache for port 5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG nova.network.neutron [req-1fb6fc7d-b767-4668-9e22-292eca3a6818 req-9192f92b-9dd6-4b41-972c-e2a82a0136eb service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Updated VIF entry in instance network info cache for port 5f826266-d1bb-4ef6-add4-41a7fb145fe4. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG nova.network.neutron [req-1fb6fc7d-b767-4668-9e22-292eca3a6818 req-9192f92b-9dd6-4b41-972c-e2a82a0136eb service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Updating instance_info_cache with network_info: [{"id": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "address": "fa:16:3e:b0:0e:0b", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f826266-d1", "ovs_interfaceid": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1fb6fc7d-b767-4668-9e22-292eca3a6818 req-9192f92b-9dd6-4b41-972c-e2a82a0136eb service nova] Releasing lock "refresh_cache-26b50488-cf81-4241-ade7-95044312ceba" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._sync_power_states {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Triggering sync for uuid c8d1df78-2aa2-4710-a570-5f72c60cfc26 {{(pid=75293) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Triggering sync for uuid ed037c80-4f33-4e03-907c-18b4ea122411 {{(pid=75293) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Triggering sync for uuid 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 {{(pid=75293) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Triggering sync for uuid 4ebf0be9-15e0-418c-a554-7885c79a725b {{(pid=75293) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Triggering sync for uuid 54c60b45-04dc-4d3b-96ec-c2d0f583cafa {{(pid=75293) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Triggering sync for uuid d89452ef-96ab-4081-bc40-0f64968de367 {{(pid=75293) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Triggering sync for uuid 26b50488-cf81-4241-ade7-95044312ceba {{(pid=75293) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "ed037c80-4f33-4e03-907c-18b4ea122411" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "ed037c80-4f33-4e03-907c-18b4ea122411" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "d89452ef-96ab-4081-bc40-0f64968de367" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "d89452ef-96ab-4081-bc40-0f64968de367" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "26b50488-cf81-4241-ade7-95044312ceba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "26b50488-cf81-4241-ade7-95044312ceba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "ed037c80-4f33-4e03-907c-18b4ea122411" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "d89452ef-96ab-4081-bc40-0f64968de367" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "26b50488-cf81-4241-ade7-95044312ceba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "26b50488-cf81-4241-ade7-95044312ceba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "26b50488-cf81-4241-ade7-95044312ceba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG nova.objects.instance [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lazy-loading 'flavor' on Instance uuid 26b50488-cf81-4241-ade7-95044312ceba {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "26b50488-cf81-4241-ade7-95044312ceba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "26b50488-cf81-4241-ade7-95044312ceba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "26b50488-cf81-4241-ade7-95044312ceba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:45 user nova-compute[75293]: INFO nova.compute.manager [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Attaching volume 71aae3ce-123c-4ae3-9c06-9a0556b21981 to /dev/vdb
Nov 30 07:23:45 user nova-compute[75293]: DEBUG os_brick.utils [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f88cebb-e66b-4a8a-8341-0d715b619020]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[061c49e0-f480-4426-abcc-98af10f27958]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dfec0c-37dc-4db2-bdf6-dd21b83d3f08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1250971f-8423-4d1f-a64a-6ab1da9c9200]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:23:45 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:23:45 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8ee753-2065-4022-9130-4e094df3950d]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG os_brick.utils [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:23:45 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Updating existing volume attachment record: ae28da3b-a0f4-47c3-93df-447ee5824297 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:23:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLtvUqQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:23:53 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:23:53 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:23:53 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef474af6-57e5-42a9-9ee8-75d99754fdc7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:23:53 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2841414c-f279-4589-a9d4-684291fdc535]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981] added
Nov 30 07:23:53 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddedd8c5-b331-4acb-85d1-783e292a68e0]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51f3400-d1a4-40b8-9fbe-e2f156b36cc8]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uLtvUqQF {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uLtvUqQF" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddfbe98-0899-460f-a1e5-eb9e3c1cb607]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uLtvUqQF'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef03d76-ab2e-44ab-b272-c9b974f2b9d2]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7d3ee7-ab84-471c-96b7-c98c2378f618]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:23:53 user nova-compute[75293]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 (non-flash)
Nov 30 07:23:53 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:23:53 user nova-compute[75293]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 (non-flash)
Nov 30 07:23:53 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdc7ae1-8700-4efc-845e-b56811b38e73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981, portal: 172.16.0.220,3260]
Nov 30 07:23:53 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981, portal: 172.16.0.220,3260] successful.
Nov 30 07:23:53 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69ef8ff-8161-4fae-a754-d7f968f21a61]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9bc29e-7bc3-486f-8738-d224dabda11a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:23:53 user nova-compute[75293]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 (non-flash)
Nov 30 07:23:53 user nova-compute[75293]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 (non-flash)
Nov 30 07:23:53 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:23:53 user nova-compute[75293]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 (non-flash)
Nov 30 07:23:53 user nova-compute[75293]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 (non-flash)
Nov 30 07:23:53 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd440025-8714-4c8b-bae1-9858dbbf122a]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:53 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:23:54 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:23:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLtvUqQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:23:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:23:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23837326662393064', 'path': '/dev/sdb'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:23:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837326662393064', 'path': '/dev/sdb'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:23:54 user nova-compute[75293]: DEBUG nova.objects.instance [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lazy-loading 'flavor' on Instance uuid 26b50488-cf81-4241-ade7-95044312ceba {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:23:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:23:54 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:23:54 user nova-compute[75293]:   <source dev="/dev/sdb"/>
Nov 30 07:23:54 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:23:54 user nova-compute[75293]:   <serial>71aae3ce-123c-4ae3-9c06-9a0556b21981</serial>
Nov 30 07:23:54 user nova-compute[75293]: </disk>
Nov 30 07:23:54 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] No VIF found with MAC fa:16:3e:b0:0e:0b, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ac5b2b2c-1760-4fb3-9815-aea4719c8687 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "26b50488-cf81-4241-ade7-95044312ceba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.066s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:55 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4ebf0be9-15e0-418c-a554-7885c79a725b is timed out.
Nov 30 07:23:55 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Successfully detached device vdb from instance 4ebf0be9-15e0-418c-a554-7885c79a725b from the live domain config.
Nov 30 07:23:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UZIfGQAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:23:55 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa396297-faca-4bca-a51c-2ceb691effcb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:23:55 user nova-compute[75293]: No targets found.
Nov 30 07:23:55 user nova-compute[75293]: iSNS:
Nov 30 07:23:55 user nova-compute[75293]: No targets found.
Nov 30 07:23:55 user nova-compute[75293]: STATIC:
Nov 30 07:23:55 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:23:55 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:23:55 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:23:55 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892
Nov 30 07:23:55 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:23:55 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:23:55 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981
Nov 30 07:23:55 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:23:55 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:23:55 user nova-compute[75293]: FIRMWARE:
Nov 30 07:23:55 user nova-compute[75293]: No targets found.
Nov 30 07:23:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:23:55 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:23:55 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4aa3128-5b11-464d-acf6-1051e97e8278]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2c5643-d32e-4f1c-a9eb-42e0027e29b4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:23:55 user nova-compute[75293]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 (non-flash)
Nov 30 07:23:55 user nova-compute[75293]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 (non-flash)
Nov 30 07:23:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:23:55 user nova-compute[75293]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 (non-flash)
Nov 30 07:23:55 user nova-compute[75293]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 (non-flash)
Nov 30 07:23:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe83c16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892'): ({'sdc'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Removing single pathed devices sdc {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef0fd55-395a-4515-842a-f7d36d94a97a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3970b537-6e14-4e01-8f85-80dc270e9937]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Flushing IO for device /dev/sdc {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd06acb-02bf-49ca-bcc3-ec18f727d336]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2b060c-bac8-44c0-8bf3-ae3ce4888f67]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d4b89d-1448-4236-8940-8725be9723db]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4badef0a-7844-4248-aa84-6808a209d1f7]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892, portal: 172.16.0.220,3260]
Nov 30 07:23:55 user nova-compute[75293]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892, portal: 172.16.0.220,3260] successful.
Nov 30 07:23:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3492db-bd54-4367-82ef-e810cc2aa892 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f945f93b-af1f-4c21-ab82-63b195431ff3]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] <== disconnect_volume: return (300ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:23:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:23:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "26b50488-cf81-4241-ade7-95044312ceba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "26b50488-cf81-4241-ade7-95044312ceba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:56 user nova-compute[75293]: INFO nova.compute.manager [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Detaching volume 71aae3ce-123c-4ae3-9c06-9a0556b21981
Nov 30 07:23:56 user nova-compute[75293]: INFO nova.virt.block_device [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Attempting to driver detach volume 71aae3ce-123c-4ae3-9c06-9a0556b21981 from mountpoint /dev/vdb
Nov 30 07:23:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Attempting to detach device vdb from instance 26b50488-cf81-4241-ade7-95044312ceba from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:23:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:23:56 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:23:56 user nova-compute[75293]:   <source dev="/dev/sdb"/>
Nov 30 07:23:56 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:23:56 user nova-compute[75293]:   <serial>71aae3ce-123c-4ae3-9c06-9a0556b21981</serial>
Nov 30 07:23:56 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:23:56 user nova-compute[75293]: </disk>
Nov 30 07:23:56 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:23:56 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Successfully detached device vdb from instance 26b50488-cf81-4241-ade7-95044312ceba from the persistent domain config.
Nov 30 07:23:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 26b50488-cf81-4241-ade7-95044312ceba from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:23:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:23:56 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:23:56 user nova-compute[75293]:   <source dev="/dev/sdb"/>
Nov 30 07:23:56 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:23:56 user nova-compute[75293]:   <serial>71aae3ce-123c-4ae3-9c06-9a0556b21981</serial>
Nov 30 07:23:56 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:23:56 user nova-compute[75293]: </disk>
Nov 30 07:23:56 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:23:56 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lazy-loading 'flavor' on Instance uuid 4ebf0be9-15e0-418c-a554-7885c79a725b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:23:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:23:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:23:56 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:23:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8d48c576-2058-4eea-8770-e96d7a0df220 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.851s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 13.900s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:56 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 26b50488-cf81-4241-ade7-95044312ceba {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:23:58 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:23:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:23:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:23:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:23:58 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:23:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:23:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:23:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:23:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:24:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:00 user nova-compute[75293]: DEBUG nova.compute.manager [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:24:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:00 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:00 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:24:00 user nova-compute[75293]: INFO nova.compute.claims [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Claim successful on node user
Nov 30 07:24:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:01 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:24:01 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:24:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=8202MB free_disk=24.954906463623047GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.726s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG nova.compute.manager [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.101s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG nova.compute.manager [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG nova.network.neutron [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:24:01 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:24:01 user nova-compute[75293]: DEBUG nova.compute.manager [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance c8d1df78-2aa2-4710-a570-5f72c60cfc26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance ed037c80-4f33-4e03-907c-18b4ea122411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 4ebf0be9-15e0-418c-a554-7885c79a725b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 54c60b45-04dc-4d3b-96ec-c2d0f583cafa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance d89452ef-96ab-4081-bc40-0f64968de367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 26b50488-cf81-4241-ade7-95044312ceba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance e67ad73a-2c4b-4cfe-acc5-e62d95d09318 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:24:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:24:01 user nova-compute[75293]: INFO nova.virt.block_device [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Booting with volume-backed-image 0546aff3-0862-4c77-a7b6-1bcd52baadc2 at /dev/vda
Nov 30 07:24:01 user nova-compute[75293]: DEBUG nova.policy [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83119c1bbe4142a086680a113403018c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09e4044dadb4f2aa0d29f35f23008d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:24:02 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:24:02 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:24:02 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:24:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:02 user nova-compute[75293]: DEBUG nova.network.neutron [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Successfully created port: ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:24:03 user nova-compute[75293]: DEBUG nova.network.neutron [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Successfully updated port: ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:24:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "refresh_cache-e67ad73a-2c4b-4cfe-acc5-e62d95d09318" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:24:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquired lock "refresh_cache-e67ad73a-2c4b-4cfe-acc5-e62d95d09318" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:24:03 user nova-compute[75293]: DEBUG nova.network.neutron [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:24:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-70e248f8-1c19-489a-9321-c740099db0aa req-bc711770-451a-4ef3-86dc-f650bf33b13b service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received event network-changed-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:24:03 user nova-compute[75293]: DEBUG nova.compute.manager [req-70e248f8-1c19-489a-9321-c740099db0aa req-bc711770-451a-4ef3-86dc-f650bf33b13b service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Refreshing instance network info cache due to event network-changed-ce63f6a4-4402-477b-9c67-d63143bfa7c9. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:24:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-70e248f8-1c19-489a-9321-c740099db0aa req-bc711770-451a-4ef3-86dc-f650bf33b13b service nova] Acquiring lock "refresh_cache-e67ad73a-2c4b-4cfe-acc5-e62d95d09318" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:24:03 user nova-compute[75293]: DEBUG nova.network.neutron [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:24:03 user nova-compute[75293]: DEBUG nova.network.neutron [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Updating instance_info_cache with network_info: [{"id": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "address": "fa:16:3e:80:e5:cd", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce63f6a4-44", "ovs_interfaceid": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:24:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Releasing lock "refresh_cache-e67ad73a-2c4b-4cfe-acc5-e62d95d09318" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:24:03 user nova-compute[75293]: DEBUG nova.compute.manager [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Instance network_info: |[{"id": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "address": "fa:16:3e:80:e5:cd", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce63f6a4-44", "ovs_interfaceid": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:24:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-70e248f8-1c19-489a-9321-c740099db0aa req-bc711770-451a-4ef3-86dc-f650bf33b13b service nova] Acquired lock "refresh_cache-e67ad73a-2c4b-4cfe-acc5-e62d95d09318" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:24:03 user nova-compute[75293]: DEBUG nova.network.neutron [req-70e248f8-1c19-489a-9321-c740099db0aa req-bc711770-451a-4ef3-86dc-f650bf33b13b service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Refreshing network info cache for port ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:24:03 user nova-compute[75293]: DEBUG nova.network.neutron [req-70e248f8-1c19-489a-9321-c740099db0aa req-bc711770-451a-4ef3-86dc-f650bf33b13b service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Updated VIF entry in instance network info cache for port ce63f6a4-4402-477b-9c67-d63143bfa7c9. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:24:03 user nova-compute[75293]: DEBUG nova.network.neutron [req-70e248f8-1c19-489a-9321-c740099db0aa req-bc711770-451a-4ef3-86dc-f650bf33b13b service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Updating instance_info_cache with network_info: [{"id": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "address": "fa:16:3e:80:e5:cd", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce63f6a4-44", "ovs_interfaceid": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:24:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-70e248f8-1c19-489a-9321-c740099db0aa req-bc711770-451a-4ef3-86dc-f650bf33b13b service nova] Releasing lock "refresh_cache-e67ad73a-2c4b-4cfe-acc5-e62d95d09318" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:24:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:24:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:24:04 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:24:04 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Didn't find any instances for network info cache update. {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 07:24:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:24:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:24:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:24:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:24:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:05 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:24:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:05 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:24:05 user nova-compute[75293]: INFO nova.compute.claims [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Claim successful on node user
Nov 30 07:24:06 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:24:06 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:24:06 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG nova.policy [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a86d36e3fa88466d9a047e9370468ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f979cf6621554018bbb90c09afd87c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:24:06 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Creating image(s)
Nov 30 07:24:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "/opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "/opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "/opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.184s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.169s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/disk 1073741824" returned: 0 in 0.050s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Successfully created port: 0160f878-44ac-4d72-937c-4479bb41226d {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.182s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Cannot resize image /opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Ensure instance console log exists: /opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Successfully updated port: 0160f878-44ac-4d72-937c-4479bb41226d {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "refresh_cache-47068cdd-7fbb-4612-892e-bfdccdac9cbd" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquired lock "refresh_cache-47068cdd-7fbb-4612-892e-bfdccdac9cbd" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.compute.manager [req-101280b5-1910-4c80-bff1-27bf02142eaa req-84cd5824-f158-4072-824c-60ccf0e141d3 service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Received event network-changed-0160f878-44ac-4d72-937c-4479bb41226d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.compute.manager [req-101280b5-1910-4c80-bff1-27bf02142eaa req-84cd5824-f158-4072-824c-60ccf0e141d3 service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Refreshing instance network info cache due to event network-changed-0160f878-44ac-4d72-937c-4479bb41226d. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-101280b5-1910-4c80-bff1-27bf02142eaa req-84cd5824-f158-4072-824c-60ccf0e141d3 service nova] Acquiring lock "refresh_cache-47068cdd-7fbb-4612-892e-bfdccdac9cbd" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.network.neutron [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Updating instance_info_cache with network_info: [{"id": "0160f878-44ac-4d72-937c-4479bb41226d", "address": "fa:16:3e:80:bb:2c", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0160f878-44", "ovs_interfaceid": "0160f878-44ac-4d72-937c-4479bb41226d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Releasing lock "refresh_cache-47068cdd-7fbb-4612-892e-bfdccdac9cbd" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Instance network_info: |[{"id": "0160f878-44ac-4d72-937c-4479bb41226d", "address": "fa:16:3e:80:bb:2c", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0160f878-44", "ovs_interfaceid": "0160f878-44ac-4d72-937c-4479bb41226d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-101280b5-1910-4c80-bff1-27bf02142eaa req-84cd5824-f158-4072-824c-60ccf0e141d3 service nova] Acquired lock "refresh_cache-47068cdd-7fbb-4612-892e-bfdccdac9cbd" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.network.neutron [req-101280b5-1910-4c80-bff1-27bf02142eaa req-84cd5824-f158-4072-824c-60ccf0e141d3 service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Refreshing network info cache for port 0160f878-44ac-4d72-937c-4479bb41226d {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Start _get_guest_xml network_info=[{"id": "0160f878-44ac-4d72-937c-4479bb41226d", "address": "fa:16:3e:80:bb:2c", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0160f878-44", "ovs_interfaceid": "0160f878-44ac-4d72-937c-4479bb41226d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:24:07 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:24:07 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:24:07 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-160652340',display_name='tempest-VolumesSnapshotTestJSON-instance-160652340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-160652340',id=39,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAirQXqAgz0frAhGtPxQdpRjKIW8W/6VepmdDqvZZ5ViOqv+ZmqnBccv3Teo/CugUTpu23hTXx/7UtXXWsJv7GX7ZsllqZ2GWU/YUv5ca0WUSlv0OzmEf5SN+kkS0ycNnw==',key_name='tempest-keypair-1275484145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f979cf6621554018bbb90c09afd87c5a',ramdisk_id='',reservation_id='r-kekk2awn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-73863621',owner_user_name='tempest-VolumesSnapshotTestJSON-73863621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:24:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a86d36e3fa88466d9a047e9370468ecc',uuid=47068cdd-7fbb-4612-892e-bfdccdac9cbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0160f878-44ac-4d72-937c-4479bb41226d", "address": "fa:16:3e:80:bb:2c", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0160f878-44", "ovs_interfaceid": "0160f878-44ac-4d72-937c-4479bb41226d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Converting VIF {"id": "0160f878-44ac-4d72-937c-4479bb41226d", "address": "fa:16:3e:80:bb:2c", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0160f878-44", "ovs_interfaceid": "0160f878-44ac-4d72-937c-4479bb41226d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=0160f878-44ac-4d72-937c-4479bb41226d,network=Network(0f103825-2792-47bf-b5e2-1108396c6212),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0160f878-44') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG nova.objects.instance [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lazy-loading 'pci_devices' on Instance uuid 47068cdd-7fbb-4612-892e-bfdccdac9cbd {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:24:08 user nova-compute[75293]:   <uuid>47068cdd-7fbb-4612-892e-bfdccdac9cbd</uuid>
Nov 30 07:24:08 user nova-compute[75293]:   <name>instance-00000027</name>
Nov 30 07:24:08 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:24:08 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:24:08 user nova-compute[75293]:   <metadata>
Nov 30 07:24:08 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:24:08 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:24:08 user nova-compute[75293]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-160652340</nova:name>
Nov 30 07:24:08 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:24:07</nova:creationTime>
Nov 30 07:24:08 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:24:08 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:24:08 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:24:08 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:24:08 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:24:08 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:24:08 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:24:08 user nova-compute[75293]:       <nova:owner>
Nov 30 07:24:08 user nova-compute[75293]:         <nova:user uuid="a86d36e3fa88466d9a047e9370468ecc">tempest-VolumesSnapshotTestJSON-73863621-project-member</nova:user>
Nov 30 07:24:08 user nova-compute[75293]:         <nova:project uuid="f979cf6621554018bbb90c09afd87c5a">tempest-VolumesSnapshotTestJSON-73863621</nova:project>
Nov 30 07:24:08 user nova-compute[75293]:       </nova:owner>
Nov 30 07:24:08 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:24:08 user nova-compute[75293]:       <nova:ports>
Nov 30 07:24:08 user nova-compute[75293]:         <nova:port uuid="0160f878-44ac-4d72-937c-4479bb41226d">
Nov 30 07:24:08 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 30 07:24:08 user nova-compute[75293]:         </nova:port>
Nov 30 07:24:08 user nova-compute[75293]:       </nova:ports>
Nov 30 07:24:08 user nova-compute[75293]:     </nova:instance>
Nov 30 07:24:08 user nova-compute[75293]:   </metadata>
Nov 30 07:24:08 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:24:08 user nova-compute[75293]:     <system>
Nov 30 07:24:08 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:24:08 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:24:08 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:24:08 user nova-compute[75293]:       <entry name="serial">47068cdd-7fbb-4612-892e-bfdccdac9cbd</entry>
Nov 30 07:24:08 user nova-compute[75293]:       <entry name="uuid">47068cdd-7fbb-4612-892e-bfdccdac9cbd</entry>
Nov 30 07:24:08 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:24:08 user nova-compute[75293]:     </system>
Nov 30 07:24:08 user nova-compute[75293]:   </sysinfo>
Nov 30 07:24:08 user nova-compute[75293]:   <os>
Nov 30 07:24:08 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:24:08 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:24:08 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:24:08 user nova-compute[75293]:   </os>
Nov 30 07:24:08 user nova-compute[75293]:   <features>
Nov 30 07:24:08 user nova-compute[75293]:     <acpi/>
Nov 30 07:24:08 user nova-compute[75293]:     <apic/>
Nov 30 07:24:08 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:24:08 user nova-compute[75293]:   </features>
Nov 30 07:24:08 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:24:08 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:24:08 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:24:08 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:24:08 user nova-compute[75293]:   </clock>
Nov 30 07:24:08 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:24:08 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:24:08 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:24:08 user nova-compute[75293]:   </cpu>
Nov 30 07:24:08 user nova-compute[75293]:   <devices>
Nov 30 07:24:08 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:24:08 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:24:08 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/disk"/>
Nov 30 07:24:08 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:24:08 user nova-compute[75293]:     </disk>
Nov 30 07:24:08 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:24:08 user nova-compute[75293]:       <mac address="fa:16:3e:80:bb:2c"/>
Nov 30 07:24:08 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:24:08 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:24:08 user nova-compute[75293]:       <target dev="tap0160f878-44"/>
Nov 30 07:24:08 user nova-compute[75293]:     </interface>
Nov 30 07:24:08 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:24:08 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/console.log" append="off"/>
Nov 30 07:24:08 user nova-compute[75293]:     </serial>
Nov 30 07:24:08 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:24:08 user nova-compute[75293]:     <video>
Nov 30 07:24:08 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:24:08 user nova-compute[75293]:     </video>
Nov 30 07:24:08 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:24:08 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:24:08 user nova-compute[75293]:     </rng>
Nov 30 07:24:08 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:24:08 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:24:08 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:24:08 user nova-compute[75293]:     </memballoon>
Nov 30 07:24:08 user nova-compute[75293]:   </devices>
Nov 30 07:24:08 user nova-compute[75293]: </domain>
Nov 30 07:24:08 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-160652340',display_name='tempest-VolumesSnapshotTestJSON-instance-160652340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-160652340',id=39,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAirQXqAgz0frAhGtPxQdpRjKIW8W/6VepmdDqvZZ5ViOqv+ZmqnBccv3Teo/CugUTpu23hTXx/7UtXXWsJv7GX7ZsllqZ2GWU/YUv5ca0WUSlv0OzmEf5SN+kkS0ycNnw==',key_name='tempest-keypair-1275484145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f979cf6621554018bbb90c09afd87c5a',ramdisk_id='',reservation_id='r-kekk2awn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-73863621',owner_user_name='tempest-VolumesSnapshotTestJSON-73863621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:24:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a86d36e3fa88466d9a047e9370468ecc',uuid=47068cdd-7fbb-4612-892e-bfdccdac9cbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0160f878-44ac-4d72-937c-4479bb41226d", "address": "fa:16:3e:80:bb:2c", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0160f878-44", "ovs_interfaceid": "0160f878-44ac-4d72-937c-4479bb41226d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Converting VIF {"id": "0160f878-44ac-4d72-937c-4479bb41226d", "address": "fa:16:3e:80:bb:2c", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0160f878-44", "ovs_interfaceid": "0160f878-44ac-4d72-937c-4479bb41226d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=0160f878-44ac-4d72-937c-4479bb41226d,network=Network(0f103825-2792-47bf-b5e2-1108396c6212),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0160f878-44') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG os_vif [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=0160f878-44ac-4d72-937c-4479bb41226d,network=Network(0f103825-2792-47bf-b5e2-1108396c6212),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0160f878-44') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e1c6bf9-90bb-5f1e-9ce2-ed51e8136c50', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0160f878-44, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0160f878-44, col_values=(('qos', UUID('22ebab4a-f488-4b3c-9127-433d326d05c0')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0160f878-44, col_values=(('external_ids', {'iface-id': '0160f878-44ac-4d72-937c-4479bb41226d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:bb:2c', 'vm-uuid': '47068cdd-7fbb-4612-892e-bfdccdac9cbd'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:08 user nova-compute[75293]: INFO os_vif [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=0160f878-44ac-4d72-937c-4479bb41226d,network=Network(0f103825-2792-47bf-b5e2-1108396c6212),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0160f878-44')
Nov 30 07:24:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] No VIF found with MAC fa:16:3e:80:bb:2c, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG nova.network.neutron [req-101280b5-1910-4c80-bff1-27bf02142eaa req-84cd5824-f158-4072-824c-60ccf0e141d3 service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Updated VIF entry in instance network info cache for port 0160f878-44ac-4d72-937c-4479bb41226d. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG nova.network.neutron [req-101280b5-1910-4c80-bff1-27bf02142eaa req-84cd5824-f158-4072-824c-60ccf0e141d3 service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Updating instance_info_cache with network_info: [{"id": "0160f878-44ac-4d72-937c-4479bb41226d", "address": "fa:16:3e:80:bb:2c", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0160f878-44", "ovs_interfaceid": "0160f878-44ac-4d72-937c-4479bb41226d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:24:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-101280b5-1910-4c80-bff1-27bf02142eaa req-84cd5824-f158-4072-824c-60ccf0e141d3 service nova] Releasing lock "refresh_cache-47068cdd-7fbb-4612-892e-bfdccdac9cbd" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:24:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:09 user nova-compute[75293]: DEBUG nova.compute.manager [req-ab643885-7276-46c3-b6e5-ac50d80a4e02 req-4d01089e-e5dd-46f8-b525-2a9c2783c6eb service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Received event network-vif-plugged-0160f878-44ac-4d72-937c-4479bb41226d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:24:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ab643885-7276-46c3-b6e5-ac50d80a4e02 req-4d01089e-e5dd-46f8-b525-2a9c2783c6eb service nova] Acquiring lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ab643885-7276-46c3-b6e5-ac50d80a4e02 req-4d01089e-e5dd-46f8-b525-2a9c2783c6eb service nova] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ab643885-7276-46c3-b6e5-ac50d80a4e02 req-4d01089e-e5dd-46f8-b525-2a9c2783c6eb service nova] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:09 user nova-compute[75293]: DEBUG nova.compute.manager [req-ab643885-7276-46c3-b6e5-ac50d80a4e02 req-4d01089e-e5dd-46f8-b525-2a9c2783c6eb service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] No waiting events found dispatching network-vif-plugged-0160f878-44ac-4d72-937c-4479bb41226d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:24:09 user nova-compute[75293]: WARNING nova.compute.manager [req-ab643885-7276-46c3-b6e5-ac50d80a4e02 req-4d01089e-e5dd-46f8-b525-2a9c2783c6eb service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Received unexpected event network-vif-plugged-0160f878-44ac-4d72-937c-4479bb41226d for instance with vm_state building and task_state spawning.
Nov 30 07:24:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:10 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:11 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:24:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:24:11 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Instance spawned successfully.
Nov 30 07:24:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:24:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:24:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:24:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:24:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:24:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:24:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:24:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-efa5d542-0f12-4841-badb-0e1227e28de2 req-0fb1c16f-1221-41ad-8d9f-1d3da3a0b757 service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Received event network-vif-plugged-0160f878-44ac-4d72-937c-4479bb41226d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:24:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-efa5d542-0f12-4841-badb-0e1227e28de2 req-0fb1c16f-1221-41ad-8d9f-1d3da3a0b757 service nova] Acquiring lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-efa5d542-0f12-4841-badb-0e1227e28de2 req-0fb1c16f-1221-41ad-8d9f-1d3da3a0b757 service nova] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-efa5d542-0f12-4841-badb-0e1227e28de2 req-0fb1c16f-1221-41ad-8d9f-1d3da3a0b757 service nova] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-efa5d542-0f12-4841-badb-0e1227e28de2 req-0fb1c16f-1221-41ad-8d9f-1d3da3a0b757 service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] No waiting events found dispatching network-vif-plugged-0160f878-44ac-4d72-937c-4479bb41226d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:24:11 user nova-compute[75293]: WARNING nova.compute.manager [req-efa5d542-0f12-4841-badb-0e1227e28de2 req-0fb1c16f-1221-41ad-8d9f-1d3da3a0b757 service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Received unexpected event network-vif-plugged-0160f878-44ac-4d72-937c-4479bb41226d for instance with vm_state building and task_state spawning.
Nov 30 07:24:11 user nova-compute[75293]: INFO nova.compute.manager [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 30 07:24:11 user nova-compute[75293]: DEBUG nova.compute.manager [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:24:11 user nova-compute[75293]: INFO nova.compute.manager [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Took 6.05 seconds to build instance.
Nov 30 07:24:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-d7df0464-6af9-40f2-bd29-631207f81ad9 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.154s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquiring lock "ed037c80-4f33-4e03-907c-18b4ea122411" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "ed037c80-4f33-4e03-907c-18b4ea122411" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquiring lock "ed037c80-4f33-4e03-907c-18b4ea122411-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "ed037c80-4f33-4e03-907c-18b4ea122411-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "ed037c80-4f33-4e03-907c-18b4ea122411-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:12 user nova-compute[75293]: INFO nova.compute.manager [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Terminating instance
Nov 30 07:24:12 user nova-compute[75293]: DEBUG nova.compute.manager [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG nova.compute.manager [req-aaf1bcdc-8379-45ac-82a0-b30226790341 req-abdf1ac6-48eb-4646-965f-4f2f5a61885c service nova] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Received event network-vif-unplugged-196acf39-315e-4e6f-b324-b4e92ccdb6b8 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-aaf1bcdc-8379-45ac-82a0-b30226790341 req-abdf1ac6-48eb-4646-965f-4f2f5a61885c service nova] Acquiring lock "ed037c80-4f33-4e03-907c-18b4ea122411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-aaf1bcdc-8379-45ac-82a0-b30226790341 req-abdf1ac6-48eb-4646-965f-4f2f5a61885c service nova] Lock "ed037c80-4f33-4e03-907c-18b4ea122411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-aaf1bcdc-8379-45ac-82a0-b30226790341 req-abdf1ac6-48eb-4646-965f-4f2f5a61885c service nova] Lock "ed037c80-4f33-4e03-907c-18b4ea122411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG nova.compute.manager [req-aaf1bcdc-8379-45ac-82a0-b30226790341 req-abdf1ac6-48eb-4646-965f-4f2f5a61885c service nova] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] No waiting events found dispatching network-vif-unplugged-196acf39-315e-4e6f-b324-b4e92ccdb6b8 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG nova.compute.manager [req-aaf1bcdc-8379-45ac-82a0-b30226790341 req-abdf1ac6-48eb-4646-965f-4f2f5a61885c service nova] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Received event network-vif-unplugged-196acf39-315e-4e6f-b324-b4e92ccdb6b8 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:24:12 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Instance destroyed successfully.
Nov 30 07:24:12 user nova-compute[75293]: DEBUG nova.objects.instance [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lazy-loading 'resources' on Instance uuid ed037c80-4f33-4e03-907c-18b4ea122411 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-721563326',display_name='tempest-ServersNegativeTestJSON-server-721563326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-721563326',id=25,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:15:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8744f39a1f6d424fa13d77ed2ced51c5',ramdisk_id='',reservation_id='r-ww2rfr2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1767090220',owner_user_name='tempest-ServersNegativeTestJSON-1767090220-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:15:33Z,user_data=None,user_id='f04441af417245e2a68e11d52ad7b05f',uuid=ed037c80-4f33-4e03-907c-18b4ea122411,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "address": "fa:16:3e:fe:7a:56", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap196acf39-31", "ovs_interfaceid": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Converting VIF {"id": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "address": "fa:16:3e:fe:7a:56", "network": {"id": "f557522c-aed7-4965-8036-cb4260a19168", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-187746179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8744f39a1f6d424fa13d77ed2ced51c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap196acf39-31", "ovs_interfaceid": "196acf39-315e-4e6f-b324-b4e92ccdb6b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:7a:56,bridge_name='br-int',has_traffic_filtering=True,id=196acf39-315e-4e6f-b324-b4e92ccdb6b8,network=Network(f557522c-aed7-4965-8036-cb4260a19168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap196acf39-31') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG os_vif [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:7a:56,bridge_name='br-int',has_traffic_filtering=True,id=196acf39-315e-4e6f-b324-b4e92ccdb6b8,network=Network(f557522c-aed7-4965-8036-cb4260a19168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap196acf39-31') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG os_brick.utils [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap196acf39-31, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f287bd12-e5ec-4ff7-9032-45e3426819ae) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:24:12 user nova-compute[75293]: INFO os_vif [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:7a:56,bridge_name='br-int',has_traffic_filtering=True,id=196acf39-315e-4e6f-b324-b4e92ccdb6b8,network=Network(f557522c-aed7-4965-8036-cb4260a19168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap196acf39-31')
Nov 30 07:24:12 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Deleting instance files /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411_del
Nov 30 07:24:12 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Deletion of /opt/stack/data/nova/instances/ed037c80-4f33-4e03-907c-18b4ea122411_del complete
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc93d64e-865d-4053-8e0c-64fedb3ddb07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[19afb38f-da87-4824-9cc8-1f18497caf07]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb87ac5f-1b8c-4572-b389-44c77c1c9aaf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[104f5358-4ce8-4912-a930-26b4ad912f1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:24:12 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:13 user nova-compute[75293]: INFO nova.compute.manager [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Took 0.80 seconds to destroy the instance on the hypervisor.
Nov 30 07:24:13 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:24:13 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:24:13 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:24:13 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a34150c-7930-42d6-b703-f8a259f721d5]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:13 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:24:13 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:24:13 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:24:13 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:24:13 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:24:13 user nova-compute[75293]: DEBUG os_brick.utils [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:24:13 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Updating existing volume attachment record: d4c1304c-7748-4810-84dc-147d1bb00c8e {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:24:13 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:24:13 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Took 0.53 seconds to deallocate network for instance.
Nov 30 07:24:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:13 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:24:13 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:24:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:13 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Deleted allocations for instance ed037c80-4f33-4e03-907c-18b4ea122411
Nov 30 07:24:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-48bba5f0-2e79-4565-b202-9b9ee27484a8 tempest-ServersNegativeTestJSON-1767090220 tempest-ServersNegativeTestJSON-1767090220-project-member] Lock "ed037c80-4f33-4e03-907c-18b4ea122411" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.869s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:14 user nova-compute[75293]: DEBUG nova.compute.manager [req-126d601a-aa7e-416f-85b2-5f9e135e435b req-9a22742d-2566-4af2-a5a7-99245150641a service nova] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Received event network-vif-plugged-196acf39-315e-4e6f-b324-b4e92ccdb6b8 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:24:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-126d601a-aa7e-416f-85b2-5f9e135e435b req-9a22742d-2566-4af2-a5a7-99245150641a service nova] Acquiring lock "ed037c80-4f33-4e03-907c-18b4ea122411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-126d601a-aa7e-416f-85b2-5f9e135e435b req-9a22742d-2566-4af2-a5a7-99245150641a service nova] Lock "ed037c80-4f33-4e03-907c-18b4ea122411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:14 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-126d601a-aa7e-416f-85b2-5f9e135e435b req-9a22742d-2566-4af2-a5a7-99245150641a service nova] Lock "ed037c80-4f33-4e03-907c-18b4ea122411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:14 user nova-compute[75293]: DEBUG nova.compute.manager [req-126d601a-aa7e-416f-85b2-5f9e135e435b req-9a22742d-2566-4af2-a5a7-99245150641a service nova] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] No waiting events found dispatching network-vif-plugged-196acf39-315e-4e6f-b324-b4e92ccdb6b8 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:24:14 user nova-compute[75293]: WARNING nova.compute.manager [req-126d601a-aa7e-416f-85b2-5f9e135e435b req-9a22742d-2566-4af2-a5a7-99245150641a service nova] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Received unexpected event network-vif-plugged-196acf39-315e-4e6f-b324-b4e92ccdb6b8 for instance with vm_state deleted and task_state None.
Nov 30 07:24:14 user nova-compute[75293]: DEBUG nova.compute.manager [req-126d601a-aa7e-416f-85b2-5f9e135e435b req-9a22742d-2566-4af2-a5a7-99245150641a service nova] [instance: ed037c80-4f33-4e03-907c-18b4ea122411] Received event network-vif-deleted-196acf39-315e-4e6f-b324-b4e92ccdb6b8 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:24:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:16 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 26b50488-cf81-4241-ade7-95044312ceba is timed out.
Nov 30 07:24:16 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Successfully detached device vdb from instance 26b50488-cf81-4241-ade7-95044312ceba from the live domain config.
Nov 30 07:24:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLtvUqQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:24:17 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac53361-5809-4687-8b7e-593b2fe84b04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:24:17 user nova-compute[75293]: No targets found.
Nov 30 07:24:17 user nova-compute[75293]: iSNS:
Nov 30 07:24:17 user nova-compute[75293]: No targets found.
Nov 30 07:24:17 user nova-compute[75293]: STATIC:
Nov 30 07:24:17 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:24:17 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:24:17 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:24:17 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981
Nov 30 07:24:17 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:24:17 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:24:17 user nova-compute[75293]: FIRMWARE:
Nov 30 07:24:17 user nova-compute[75293]: No targets found.
Nov 30 07:24:17 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:24:17 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:24:17 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3ca140-4aa3-49ed-9a86-e4867065d94c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ed63e3-86f9-4bcf-a2d5-2df2000a10d3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:24:17 user nova-compute[75293]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 (non-flash)
Nov 30 07:24:17 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:24:17 user nova-compute[75293]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 (non-flash)
Nov 30 07:24:17 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe0133910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981'): ({'sdb'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Removing single pathed devices sdb {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e324c6-b805-4c66-bd83-a18bfe1879e2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[534f7231-18d0-4023-b659-31f3cf08447f]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Flushing IO for device /dev/sdb {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[af07f39b-2a8b-44ab-b589-f4a1c02334e8]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a986e9-ca00-47e0-8ced-671e810158b5]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3902c9d-e360-4123-a4c0-a62df6b4b39c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f43d30-d279-4eb9-b466-765a43f4a7d4]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981, portal: 172.16.0.220,3260]
Nov 30 07:24:17 user nova-compute[75293]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981, portal: 172.16.0.220,3260] successful.
Nov 30 07:24:17 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71aae3ce-123c-4ae3-9c06-9a0556b21981 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cad094-460b-4459-a719-7a4e4885e80a]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] <== disconnect_volume: return (295ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:24:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:18 user nova-compute[75293]: DEBUG nova.objects.instance [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lazy-loading 'flavor' on Instance uuid 26b50488-cf81-4241-ade7-95044312ceba {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:24:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-61bf4e66-099c-4cd9-b657-59f7ca23d7da tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "26b50488-cf81-4241-ade7-95044312ceba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.663s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.compute.manager [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:24:21 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Creating image(s)
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Did not create local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Ensure instance console log exists: /opt/stack/data/nova/instances/e67ad73a-2c4b-4cfe-acc5-e62d95d09318/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Start _get_guest_xml network_info=[{"id": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "address": "fa:16:3e:80:e5:cd", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce63f6a4-44", "ovs_interfaceid": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoZTybOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e67ad73a-2c4b-4cfe-acc5-e62d95d09318', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2be752a-991a-4d8e-95a4-0e8570f54cea', 'serial': 'c2be752a-991a-4d8e-95a4-0e8570f54cea'}, 'delete_on_termination': False, 'attachment_id': 'd4c1304c-7748-4810-84dc-147d1bb00c8e', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:24:21 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:24:21 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoZTybOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:24:21 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:24:21 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:24:21 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd01c612-9e40-4e9b-9bab-71df199d3fb3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:24:21 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bd2614-c8e1-4f6e-92ab-7014be77fa96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea] added
Nov 30 07:24:21 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f33a1bf-5dcf-45bc-8e52-afb588f7086a]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d2cd62-e0d9-4ddf-898b-5a5e6c971fc0]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoZTybOa {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoZTybOa" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa709539-976a-4b57-bc34-e5ddf687bd33]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AoZTybOa'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1147e99-6275-456e-9c57-43b721a6d793]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5aa0ae-505f-42ce-8611-a54723961068]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:24:21 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:24:21 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b322e654-c69b-4a3f-a546-8b2eec139852]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea, portal: 172.16.0.220,3260]
Nov 30 07:24:21 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea, portal: 172.16.0.220,3260] successful.
Nov 30 07:24:21 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[716ae2a9-9873-44b6-9423-f0d83a2ecabe]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ab6f68-c05a-4a45-85fd-944fa1ef8c0e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:24:21 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:24:21 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:24:21 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:24:21 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab44cfc-10e3-469c-ba21-1757990d3a17]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:24:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoZTybOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26362666535383966', 'path': '/dev/sdb'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362666535383966', 'path': '/dev/sdb'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2032492824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2032492824',id=38,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09e4044dadb4f2aa0d29f35f23008d2',ramdisk_id='',reservation_id='r-4p00a3zd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:24:02Z,user_data=None,user_id='83119c1bbe4142a086680a113403018c',uuid=e67ad73a-2c4b-4cfe-acc5-e62d95d09318,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "address": "fa:16:3e:80:e5:cd", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce63f6a4-44", "ovs_interfaceid": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converting VIF {"id": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "address": "fa:16:3e:80:e5:cd", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce63f6a4-44", "ovs_interfaceid": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:e5:cd,bridge_name='br-int',has_traffic_filtering=True,id=ce63f6a4-4402-477b-9c67-d63143bfa7c9,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce63f6a4-44') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG nova.objects.instance [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'pci_devices' on Instance uuid e67ad73a-2c4b-4cfe-acc5-e62d95d09318 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:24:22 user nova-compute[75293]:   <uuid>e67ad73a-2c4b-4cfe-acc5-e62d95d09318</uuid>
Nov 30 07:24:22 user nova-compute[75293]:   <name>instance-00000026</name>
Nov 30 07:24:22 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:24:22 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:24:22 user nova-compute[75293]:   <metadata>
Nov 30 07:24:22 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:24:22 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:24:22 user nova-compute[75293]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2032492824</nova:name>
Nov 30 07:24:22 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:24:21</nova:creationTime>
Nov 30 07:24:22 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:24:22 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:24:22 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:24:22 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:24:22 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:24:22 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:24:22 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:24:22 user nova-compute[75293]:       <nova:owner>
Nov 30 07:24:22 user nova-compute[75293]:         <nova:user uuid="83119c1bbe4142a086680a113403018c">tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member</nova:user>
Nov 30 07:24:22 user nova-compute[75293]:         <nova:project uuid="f09e4044dadb4f2aa0d29f35f23008d2">tempest-ServerBootFromVolumeStableRescueTest-2053873633</nova:project>
Nov 30 07:24:22 user nova-compute[75293]:       </nova:owner>
Nov 30 07:24:22 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:24:22 user nova-compute[75293]:       <nova:ports>
Nov 30 07:24:22 user nova-compute[75293]:         <nova:port uuid="ce63f6a4-4402-477b-9c67-d63143bfa7c9">
Nov 30 07:24:22 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 07:24:22 user nova-compute[75293]:         </nova:port>
Nov 30 07:24:22 user nova-compute[75293]:       </nova:ports>
Nov 30 07:24:22 user nova-compute[75293]:     </nova:instance>
Nov 30 07:24:22 user nova-compute[75293]:   </metadata>
Nov 30 07:24:22 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:24:22 user nova-compute[75293]:     <system>
Nov 30 07:24:22 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:24:22 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:24:22 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:24:22 user nova-compute[75293]:       <entry name="serial">e67ad73a-2c4b-4cfe-acc5-e62d95d09318</entry>
Nov 30 07:24:22 user nova-compute[75293]:       <entry name="uuid">e67ad73a-2c4b-4cfe-acc5-e62d95d09318</entry>
Nov 30 07:24:22 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:24:22 user nova-compute[75293]:     </system>
Nov 30 07:24:22 user nova-compute[75293]:   </sysinfo>
Nov 30 07:24:22 user nova-compute[75293]:   <os>
Nov 30 07:24:22 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:24:22 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:24:22 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:24:22 user nova-compute[75293]:   </os>
Nov 30 07:24:22 user nova-compute[75293]:   <features>
Nov 30 07:24:22 user nova-compute[75293]:     <acpi/>
Nov 30 07:24:22 user nova-compute[75293]:     <apic/>
Nov 30 07:24:22 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:24:22 user nova-compute[75293]:   </features>
Nov 30 07:24:22 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:24:22 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:24:22 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:24:22 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:24:22 user nova-compute[75293]:   </clock>
Nov 30 07:24:22 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:24:22 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:24:22 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:24:22 user nova-compute[75293]:   </cpu>
Nov 30 07:24:22 user nova-compute[75293]:   <devices>
Nov 30 07:24:22 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:24:22 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:24:22 user nova-compute[75293]:       <source dev="/dev/sdb"/>
Nov 30 07:24:22 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:24:22 user nova-compute[75293]:       <serial>c2be752a-991a-4d8e-95a4-0e8570f54cea</serial>
Nov 30 07:24:22 user nova-compute[75293]:     </disk>
Nov 30 07:24:22 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:24:22 user nova-compute[75293]:       <mac address="fa:16:3e:80:e5:cd"/>
Nov 30 07:24:22 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:24:22 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:24:22 user nova-compute[75293]:       <target dev="tapce63f6a4-44"/>
Nov 30 07:24:22 user nova-compute[75293]:     </interface>
Nov 30 07:24:22 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:24:22 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/e67ad73a-2c4b-4cfe-acc5-e62d95d09318/console.log" append="off"/>
Nov 30 07:24:22 user nova-compute[75293]:     </serial>
Nov 30 07:24:22 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:24:22 user nova-compute[75293]:     <video>
Nov 30 07:24:22 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:24:22 user nova-compute[75293]:     </video>
Nov 30 07:24:22 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:24:22 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:24:22 user nova-compute[75293]:     </rng>
Nov 30 07:24:22 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:24:22 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:24:22 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:24:22 user nova-compute[75293]:     </memballoon>
Nov 30 07:24:22 user nova-compute[75293]:   </devices>
Nov 30 07:24:22 user nova-compute[75293]: </domain>
Nov 30 07:24:22 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2032492824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2032492824',id=38,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f09e4044dadb4f2aa0d29f35f23008d2',ramdisk_id='',reservation_id='r-4p00a3zd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:24:02Z,user_data=None,user_id='83119c1bbe4142a086680a113403018c',uuid=e67ad73a-2c4b-4cfe-acc5-e62d95d09318,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "address": "fa:16:3e:80:e5:cd", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce63f6a4-44", "ovs_interfaceid": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converting VIF {"id": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "address": "fa:16:3e:80:e5:cd", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce63f6a4-44", "ovs_interfaceid": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:e5:cd,bridge_name='br-int',has_traffic_filtering=True,id=ce63f6a4-4402-477b-9c67-d63143bfa7c9,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce63f6a4-44') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG os_vif [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:e5:cd,bridge_name='br-int',has_traffic_filtering=True,id=ce63f6a4-4402-477b-9c67-d63143bfa7c9,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce63f6a4-44') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4928b3f1-6a9d-5c1c-b28f-8b5dd1e1d617', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce63f6a4-44, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce63f6a4-44, col_values=(('qos', UUID('771c5e30-ea95-4dc3-b41c-6d6cd229182e')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce63f6a4-44, col_values=(('external_ids', {'iface-id': 'ce63f6a4-4402-477b-9c67-d63143bfa7c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:e5:cd', 'vm-uuid': 'e67ad73a-2c4b-4cfe-acc5-e62d95d09318'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:22 user nova-compute[75293]: INFO os_vif [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:e5:cd,bridge_name='br-int',has_traffic_filtering=True,id=ce63f6a4-4402-477b-9c67-d63143bfa7c9,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce63f6a4-44')
Nov 30 07:24:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:24:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] No VIF found with MAC fa:16:3e:80:e5:cd, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:24:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-fab99fd5-4e96-49e5-9a1d-862303ee6048 req-caccfd5e-9d7f-4b49-b9cf-70b2b28f803e service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:24:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fab99fd5-4e96-49e5-9a1d-862303ee6048 req-caccfd5e-9d7f-4b49-b9cf-70b2b28f803e service nova] Acquiring lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fab99fd5-4e96-49e5-9a1d-862303ee6048 req-caccfd5e-9d7f-4b49-b9cf-70b2b28f803e service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fab99fd5-4e96-49e5-9a1d-862303ee6048 req-caccfd5e-9d7f-4b49-b9cf-70b2b28f803e service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-fab99fd5-4e96-49e5-9a1d-862303ee6048 req-caccfd5e-9d7f-4b49-b9cf-70b2b28f803e service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] No waiting events found dispatching network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:24:24 user nova-compute[75293]: WARNING nova.compute.manager [req-fab99fd5-4e96-49e5-9a1d-862303ee6048 req-caccfd5e-9d7f-4b49-b9cf-70b2b28f803e service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received unexpected event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 for instance with vm_state building and task_state spawning.
Nov 30 07:24:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-1ecc5ece-357a-483f-9b2f-e4ffcfc8d5b3 req-0b6253d3-3b38-4e70-8bde-f7997f3ae7f4 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:24:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1ecc5ece-357a-483f-9b2f-e4ffcfc8d5b3 req-0b6253d3-3b38-4e70-8bde-f7997f3ae7f4 service nova] Acquiring lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1ecc5ece-357a-483f-9b2f-e4ffcfc8d5b3 req-0b6253d3-3b38-4e70-8bde-f7997f3ae7f4 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1ecc5ece-357a-483f-9b2f-e4ffcfc8d5b3 req-0b6253d3-3b38-4e70-8bde-f7997f3ae7f4 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-1ecc5ece-357a-483f-9b2f-e4ffcfc8d5b3 req-0b6253d3-3b38-4e70-8bde-f7997f3ae7f4 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] No waiting events found dispatching network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:24:26 user nova-compute[75293]: WARNING nova.compute.manager [req-1ecc5ece-357a-483f-9b2f-e4ffcfc8d5b3 req-0b6253d3-3b38-4e70-8bde-f7997f3ae7f4 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received unexpected event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 for instance with vm_state building and task_state spawning.
Nov 30 07:24:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:26 user nova-compute[75293]: DEBUG nova.compute.manager [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:24:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:24:26 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Instance spawned successfully.
Nov 30 07:24:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:24:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:24:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:24:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:24:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:24:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:24:26 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:24:26 user nova-compute[75293]: INFO nova.compute.manager [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 30 07:24:26 user nova-compute[75293]: DEBUG nova.compute.manager [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:24:26 user nova-compute[75293]: INFO nova.compute.manager [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Took 25.81 seconds to build instance.
Nov 30 07:24:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-20bdf4b4-9850-45dc-a488-b75c8500ffef tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.948s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG nova.objects.instance [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lazy-loading 'flavor' on Instance uuid 4ebf0be9-15e0-418c-a554-7885c79a725b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:28 user nova-compute[75293]: INFO nova.compute.manager [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Attaching volume b4240643-5f50-4faa-9310-d330497d477e to /dev/vdb
Nov 30 07:24:28 user nova-compute[75293]: DEBUG os_brick.utils [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cf9a9b-8522-4028-8751-c2bbcaf6876c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13a0d70-8655-43b8-8a1d-5e818c6d2161]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3d520c-c434-4072-8d17-1f6d56ddd277]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2812d377-c720-4754-8dbd-500d09bc92f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:24:28 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:24:28 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddb0b80-392e-4493-b9ab-fe1fe4d86568]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG os_brick.utils [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:24:28 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Updating existing volume attachment record: 17dd6d76-ef22-4e40-ae86-48114c491986 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:24:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmeIDlRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:24:37 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:24:37 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:24:37 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1cdffd-cc28-46af-9155-fe8e84cf194d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:24:37 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7ce8f8-6105-429f-854e-18a5787c6a60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e] added
Nov 30 07:24:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b123398-3f6d-47c8-89d0-cf6c65c36d3f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9130c866-69fe-49d4-9b30-1c54ae8e14a8]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmeIDlRE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmeIDlRE" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2f1021-6324-48a1-ab78-bcc08cabe58c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SmeIDlRE'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[060f331c-eb2e-450f-be29-accb9797418e]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[68eee74f-45a8-48b2-8b79-ebc9b308911f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:24:37 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:24:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:24:37 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:24:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64872bc-d738-4b51-b582-2d5b26b9209b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e, portal: 172.16.0.220,3260]
Nov 30 07:24:37 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e, portal: 172.16.0.220,3260] successful.
Nov 30 07:24:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3950bdae-1c47-470a-819d-27e98be5819d]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ab8df9-d22e-4fc0-9b95-53263e4a2540]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:24:37 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:24:37 user nova-compute[75293]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e (non-flash)
Nov 30 07:24:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:24:37 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:24:37 user nova-compute[75293]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e (non-flash)
Nov 30 07:24:37 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6a9ed6-7149-41b5-9c35-e6d278051fed]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmeIDlRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:24:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:24:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26463333430383836', 'path': '/dev/sdc'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:24:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463333430383836', 'path': '/dev/sdc'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:24:38 user nova-compute[75293]: DEBUG nova.objects.instance [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lazy-loading 'flavor' on Instance uuid 4ebf0be9-15e0-418c-a554-7885c79a725b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:24:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:24:38 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:24:38 user nova-compute[75293]:   <source dev="/dev/sdc"/>
Nov 30 07:24:38 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:24:38 user nova-compute[75293]:   <serial>b4240643-5f50-4faa-9310-d330497d477e</serial>
Nov 30 07:24:38 user nova-compute[75293]: </disk>
Nov 30 07:24:38 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:24:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:24:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:24:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] No VIF found with MAC fa:16:3e:61:ea:d9, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:24:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0046e4af-ab13-41a0-b7cc-b05f1d5eae69 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.982s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "11e67339-be9e-481a-a8d2-8573caa97866" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "11e67339-be9e-481a-a8d2-8573caa97866" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG nova.compute.manager [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:24:42 user nova-compute[75293]: INFO nova.compute.claims [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Claim successful on node user
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:42 user nova-compute[75293]: INFO nova.compute.manager [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Detaching volume b4240643-5f50-4faa-9310-d330497d477e
Nov 30 07:24:42 user nova-compute[75293]: INFO nova.virt.block_device [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Attempting to driver detach volume b4240643-5f50-4faa-9310-d330497d477e from mountpoint /dev/vdb
Nov 30 07:24:42 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Attempting to detach device vdb from instance 4ebf0be9-15e0-418c-a554-7885c79a725b from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:24:42 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:24:42 user nova-compute[75293]:   <source dev="/dev/sdc"/>
Nov 30 07:24:42 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:24:42 user nova-compute[75293]:   <serial>b4240643-5f50-4faa-9310-d330497d477e</serial>
Nov 30 07:24:42 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:24:42 user nova-compute[75293]: </disk>
Nov 30 07:24:42 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:24:42 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Successfully detached device vdb from instance 4ebf0be9-15e0-418c-a554-7885c79a725b from the persistent domain config.
Nov 30 07:24:42 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4ebf0be9-15e0-418c-a554-7885c79a725b from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:24:42 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:24:42 user nova-compute[75293]:   <source dev="/dev/sdc"/>
Nov 30 07:24:42 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:24:42 user nova-compute[75293]:   <serial>b4240643-5f50-4faa-9310-d330497d477e</serial>
Nov 30 07:24:42 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:24:42 user nova-compute[75293]: </disk>
Nov 30 07:24:42 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG nova.compute.manager [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG nova.compute.manager [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG nova.network.neutron [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:24:42 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:24:42 user nova-compute[75293]: DEBUG nova.compute.manager [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG nova.policy [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbee62d1b15144cc9d433a4a64dd12a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa84ea3874ba7ac0af4c3b1d2f918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:24:42 user nova-compute[75293]: INFO nova.virt.block_device [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Booting with volume b09a17d0-b9a1-48df-a557-3114c31f831c at /dev/vda
Nov 30 07:24:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4ebf0be9-15e0-418c-a554-7885c79a725b {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG os_brick.utils [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1ed6da-bb68-407a-955c-f87196842162]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a608729b-df7e-4022-a3ed-a0ef3fb34f7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[198597d8-ff37-4f50-872c-d0b992ae0593]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[905b4f46-d0a6-486b-826b-1dbf8c2d44d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:24:42 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:24:42 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[029a0c72-1404-4793-b218-ca57120290f7]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG os_brick.utils [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:24:42 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Updating existing volume attachment record: 9789516c-697d-45a4-8c69-309eac36c865 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:24:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:43 user nova-compute[75293]: DEBUG nova.network.neutron [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Successfully created port: 1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:24:44 user nova-compute[75293]: DEBUG nova.network.neutron [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Successfully updated port: 1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:24:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "refresh_cache-11e67339-be9e-481a-a8d2-8573caa97866" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:24:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquired lock "refresh_cache-11e67339-be9e-481a-a8d2-8573caa97866" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:24:44 user nova-compute[75293]: DEBUG nova.network.neutron [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:24:44 user nova-compute[75293]: DEBUG nova.compute.manager [req-ebdc28db-a7ac-400e-9dd0-f8f256743799 req-25fc22f7-5d5d-4a82-9fd5-0d3c5c60b559 service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Received event network-changed-1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:24:44 user nova-compute[75293]: DEBUG nova.compute.manager [req-ebdc28db-a7ac-400e-9dd0-f8f256743799 req-25fc22f7-5d5d-4a82-9fd5-0d3c5c60b559 service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Refreshing instance network info cache due to event network-changed-1582c6d0-9518-41fa-907e-7c64af37731b. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:24:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ebdc28db-a7ac-400e-9dd0-f8f256743799 req-25fc22f7-5d5d-4a82-9fd5-0d3c5c60b559 service nova] Acquiring lock "refresh_cache-11e67339-be9e-481a-a8d2-8573caa97866" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:24:44 user nova-compute[75293]: DEBUG nova.network.neutron [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:24:44 user nova-compute[75293]: DEBUG nova.network.neutron [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Updating instance_info_cache with network_info: [{"id": "1582c6d0-9518-41fa-907e-7c64af37731b", "address": "fa:16:3e:88:c5:08", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1582c6d0-95", "ovs_interfaceid": "1582c6d0-9518-41fa-907e-7c64af37731b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:24:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Releasing lock "refresh_cache-11e67339-be9e-481a-a8d2-8573caa97866" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:24:44 user nova-compute[75293]: DEBUG nova.compute.manager [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Instance network_info: |[{"id": "1582c6d0-9518-41fa-907e-7c64af37731b", "address": "fa:16:3e:88:c5:08", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1582c6d0-95", "ovs_interfaceid": "1582c6d0-9518-41fa-907e-7c64af37731b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:24:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ebdc28db-a7ac-400e-9dd0-f8f256743799 req-25fc22f7-5d5d-4a82-9fd5-0d3c5c60b559 service nova] Acquired lock "refresh_cache-11e67339-be9e-481a-a8d2-8573caa97866" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:24:44 user nova-compute[75293]: DEBUG nova.network.neutron [req-ebdc28db-a7ac-400e-9dd0-f8f256743799 req-25fc22f7-5d5d-4a82-9fd5-0d3c5c60b559 service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Refreshing network info cache for port 1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:24:44 user nova-compute[75293]: DEBUG nova.network.neutron [req-ebdc28db-a7ac-400e-9dd0-f8f256743799 req-25fc22f7-5d5d-4a82-9fd5-0d3c5c60b559 service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Updated VIF entry in instance network info cache for port 1582c6d0-9518-41fa-907e-7c64af37731b. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:24:44 user nova-compute[75293]: DEBUG nova.network.neutron [req-ebdc28db-a7ac-400e-9dd0-f8f256743799 req-25fc22f7-5d5d-4a82-9fd5-0d3c5c60b559 service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Updating instance_info_cache with network_info: [{"id": "1582c6d0-9518-41fa-907e-7c64af37731b", "address": "fa:16:3e:88:c5:08", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1582c6d0-95", "ovs_interfaceid": "1582c6d0-9518-41fa-907e-7c64af37731b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:24:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ebdc28db-a7ac-400e-9dd0-f8f256743799 req-25fc22f7-5d5d-4a82-9fd5-0d3c5c60b559 service nova] Releasing lock "refresh_cache-11e67339-be9e-481a-a8d2-8573caa97866" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:24:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "26b50488-cf81-4241-ade7-95044312ceba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "26b50488-cf81-4241-ade7-95044312ceba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "26b50488-cf81-4241-ade7-95044312ceba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "26b50488-cf81-4241-ade7-95044312ceba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "26b50488-cf81-4241-ade7-95044312ceba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:46 user nova-compute[75293]: INFO nova.compute.manager [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Terminating instance
Nov 30 07:24:46 user nova-compute[75293]: DEBUG nova.compute.manager [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:24:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-cde9605d-3331-497b-af25-4094a7070596 req-94351e8f-29ec-48e0-ac3b-9f5694ec9a74 service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Received event network-vif-unplugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cde9605d-3331-497b-af25-4094a7070596 req-94351e8f-29ec-48e0-ac3b-9f5694ec9a74 service nova] Acquiring lock "26b50488-cf81-4241-ade7-95044312ceba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cde9605d-3331-497b-af25-4094a7070596 req-94351e8f-29ec-48e0-ac3b-9f5694ec9a74 service nova] Lock "26b50488-cf81-4241-ade7-95044312ceba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cde9605d-3331-497b-af25-4094a7070596 req-94351e8f-29ec-48e0-ac3b-9f5694ec9a74 service nova] Lock "26b50488-cf81-4241-ade7-95044312ceba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-cde9605d-3331-497b-af25-4094a7070596 req-94351e8f-29ec-48e0-ac3b-9f5694ec9a74 service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] No waiting events found dispatching network-vif-unplugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-cde9605d-3331-497b-af25-4094a7070596 req-94351e8f-29ec-48e0-ac3b-9f5694ec9a74 service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Received event network-vif-unplugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:47 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Instance destroyed successfully.
Nov 30 07:24:47 user nova-compute[75293]: DEBUG nova.objects.instance [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lazy-loading 'resources' on Instance uuid 26b50488-cf81-4241-ade7-95044312ceba {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:21:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1485978704',display_name='tempest-AttachVolumeNegativeTest-server-1485978704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1485978704',id=37,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEECe7dMj0qydDG31h1Tj/zo2fcB3dEQzOSe98fJK3wGhjIz6IwPTHB6eHemv4DLp97bwQ8LbXcYSN7giep+TjVFr9fFhRRgl5abVEoL7H1mxTMbhVkbtbyKKxQNGbMIDQ==',key_name='tempest-keypair-112879234',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:21:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68ff34b2e2c047319c1fe166c5029790',ramdisk_id='',reservation_id='r-7avgffk8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1915468397',owner_user_name='tempest-AttachVolumeNegativeTest-1915468397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:21:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe34a1b2c38472d831ae5d7afa85c77',uuid=26b50488-cf81-4241-ade7-95044312ceba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "address": "fa:16:3e:b0:0e:0b", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f826266-d1", "ovs_interfaceid": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converting VIF {"id": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "address": "fa:16:3e:b0:0e:0b", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f826266-d1", "ovs_interfaceid": "5f826266-d1bb-4ef6-add4-41a7fb145fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:0e:0b,bridge_name='br-int',has_traffic_filtering=True,id=5f826266-d1bb-4ef6-add4-41a7fb145fe4,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f826266-d1') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG os_vif [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:0e:0b,bridge_name='br-int',has_traffic_filtering=True,id=5f826266-d1bb-4ef6-add4-41a7fb145fe4,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f826266-d1') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f826266-d1, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75631c36-86d4-45d6-8ec3-e550761cf401) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:24:47 user nova-compute[75293]: INFO os_vif [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:0e:0b,bridge_name='br-int',has_traffic_filtering=True,id=5f826266-d1bb-4ef6-add4-41a7fb145fe4,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f826266-d1')
Nov 30 07:24:47 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Deleting instance files /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba_del
Nov 30 07:24:47 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Deletion of /opt/stack/data/nova/instances/26b50488-cf81-4241-ade7-95044312ceba_del complete
Nov 30 07:24:47 user nova-compute[75293]: INFO nova.compute.manager [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 30 07:24:47 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:24:47 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 26b50488-cf81-4241-ade7-95044312ceba] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:24:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:48 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:24:48 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Took 0.67 seconds to deallocate network for instance.
Nov 30 07:24:48 user nova-compute[75293]: DEBUG nova.compute.manager [req-8b8a3364-2def-41ad-98a1-b32de849e916 req-5a48436c-a8f1-4a79-bc6d-0ffb58ea881c service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Received event network-vif-deleted-5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:24:48 user nova-compute[75293]: INFO nova.compute.manager [req-8b8a3364-2def-41ad-98a1-b32de849e916 req-5a48436c-a8f1-4a79-bc6d-0ffb58ea881c service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Neutron deleted interface 5f826266-d1bb-4ef6-add4-41a7fb145fe4; detaching it from the instance and deleting it from the info cache
Nov 30 07:24:48 user nova-compute[75293]: DEBUG nova.network.neutron [req-8b8a3364-2def-41ad-98a1-b32de849e916 req-5a48436c-a8f1-4a79-bc6d-0ffb58ea881c service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:24:48 user nova-compute[75293]: DEBUG nova.compute.manager [req-8b8a3364-2def-41ad-98a1-b32de849e916 req-5a48436c-a8f1-4a79-bc6d-0ffb58ea881c service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Detach interface failed, port_id=5f826266-d1bb-4ef6-add4-41a7fb145fe4, reason: Instance 26b50488-cf81-4241-ade7-95044312ceba could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:24:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:48 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:24:48 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:24:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:48 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Deleted allocations for instance 26b50488-cf81-4241-ade7-95044312ceba
Nov 30 07:24:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-e5c63a3e-14e7-4a7c-82ec-74c8b978bf9b tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "26b50488-cf81-4241-ade7-95044312ceba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.248s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG nova.compute.manager [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Received event network-vif-plugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] Acquiring lock "26b50488-cf81-4241-ade7-95044312ceba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] Lock "26b50488-cf81-4241-ade7-95044312ceba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] Lock "26b50488-cf81-4241-ade7-95044312ceba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG nova.compute.manager [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] No waiting events found dispatching network-vif-plugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:24:49 user nova-compute[75293]: WARNING nova.compute.manager [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Received unexpected event network-vif-plugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 for instance with vm_state deleted and task_state None.
Nov 30 07:24:49 user nova-compute[75293]: DEBUG nova.compute.manager [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Received event network-vif-plugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] Acquiring lock "26b50488-cf81-4241-ade7-95044312ceba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] Lock "26b50488-cf81-4241-ade7-95044312ceba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] Lock "26b50488-cf81-4241-ade7-95044312ceba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG nova.compute.manager [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] No waiting events found dispatching network-vif-plugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:24:49 user nova-compute[75293]: WARNING nova.compute.manager [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Received unexpected event network-vif-plugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 for instance with vm_state deleted and task_state None.
Nov 30 07:24:49 user nova-compute[75293]: DEBUG nova.compute.manager [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Received event network-vif-plugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] Acquiring lock "26b50488-cf81-4241-ade7-95044312ceba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] Lock "26b50488-cf81-4241-ade7-95044312ceba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] Lock "26b50488-cf81-4241-ade7-95044312ceba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG nova.compute.manager [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] No waiting events found dispatching network-vif-plugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:24:49 user nova-compute[75293]: WARNING nova.compute.manager [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Received unexpected event network-vif-plugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 for instance with vm_state deleted and task_state None.
Nov 30 07:24:49 user nova-compute[75293]: DEBUG nova.compute.manager [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Received event network-vif-unplugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] Acquiring lock "26b50488-cf81-4241-ade7-95044312ceba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] Lock "26b50488-cf81-4241-ade7-95044312ceba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] Lock "26b50488-cf81-4241-ade7-95044312ceba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG nova.compute.manager [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] No waiting events found dispatching network-vif-unplugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:24:49 user nova-compute[75293]: WARNING nova.compute.manager [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Received unexpected event network-vif-unplugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 for instance with vm_state deleted and task_state None.
Nov 30 07:24:49 user nova-compute[75293]: DEBUG nova.compute.manager [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Received event network-vif-plugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] Acquiring lock "26b50488-cf81-4241-ade7-95044312ceba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] Lock "26b50488-cf81-4241-ade7-95044312ceba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] Lock "26b50488-cf81-4241-ade7-95044312ceba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:49 user nova-compute[75293]: DEBUG nova.compute.manager [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] No waiting events found dispatching network-vif-plugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:24:49 user nova-compute[75293]: WARNING nova.compute.manager [req-0de00131-7a28-4076-a74d-6ccf6def3029 req-6cedb69a-d9ad-47ce-91c1-a8d571c6338a service nova] [instance: 26b50488-cf81-4241-ade7-95044312ceba] Received unexpected event network-vif-plugged-5f826266-d1bb-4ef6-add4-41a7fb145fe4 for instance with vm_state deleted and task_state None.
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.compute.manager [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:24:51 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Creating image(s)
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Did not create local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Ensure instance console log exists: /opt/stack/data/nova/instances/11e67339-be9e-481a-a8d2-8573caa97866/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Start _get_guest_xml network_info=[{"id": "1582c6d0-9518-41fa-907e-7c64af37731b", "address": "fa:16:3e:88:c5:08", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1582c6d0-95", "ovs_interfaceid": "1582c6d0-9518-41fa-907e-7c64af37731b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBSwTVJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '11e67339-be9e-481a-a8d2-8573caa97866', 'attached_at': '', 'detached_at': '', 'volume_id': 'b09a17d0-b9a1-48df-a557-3114c31f831c', 'serial': 'b09a17d0-b9a1-48df-a557-3114c31f831c'}, 'delete_on_termination': True, 'attachment_id': '9789516c-697d-45a4-8c69-309eac36c865', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:24:51 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:24:51 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBSwTVJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:24:51 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:24:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:24:51 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:24:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:24:51 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[907ca96e-72d0-41ed-9d88-e6f86f41b84b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:24:51 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab0fb16-0bfe-4362-ac93-e0a1b5b2bc98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c] added
Nov 30 07:24:51 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd34fa9-266c-495c-80de-d4b56bcfa85f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[232c400d-ca1d-4f7c-93a3-da3a5a5da30c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBSwTVJk {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBSwTVJk" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b0635f-b6a2-4a94-bd36-b52323c23da6]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lBSwTVJk'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1c6f0e-4952-4a31-8e34-c463d723dce1]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[673fa3fe-35bd-482f-9072-881fa79e68d4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:24:51 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:24:51 user nova-compute[75293]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e (non-flash)
Nov 30 07:24:51 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:24:51 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:24:51 user nova-compute[75293]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e (non-flash)
Nov 30 07:24:51 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --login" returned: 0 in 1.065s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a073b9b6-3c80-460e-a0f0-b8b19cb5fc8e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c, portal: 172.16.0.220,3260]
Nov 30 07:24:52 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c, portal: 172.16.0.220,3260] successful.
Nov 30 07:24:52 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[57334308-463d-4623-84f2-e57ad80789c3]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[02917740-3d1e-4b2f-970b-dd4066b8626e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:24:52 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:24:52 user nova-compute[75293]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e (non-flash)
Nov 30 07:24:52 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:24:52 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:24:52 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:24:52 user nova-compute[75293]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e (non-flash)
Nov 30 07:24:52 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:24:52 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.264s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc1de77-7c8e-480a-97bb-32c1832cc240]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBSwTVJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:24:52 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.297s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] <== connect_volume: return (2298ms) {'type': 'block', 'scsi_wwn': '26135356230316532', 'path': '/dev/sde'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135356230316532', 'path': '/dev/sde'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:24:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-499440655',display_name='tempest-TestVolumeBootPattern-volume-backed-server-499440655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-499440655',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdxGSQCpq3eCaS2wDTlAbV+wJ9939OUTl3NOz3PUxrF4CalT3ANXoFQsRDiODkeO9GbfLkFc34D1JdUPV8OkpoMwrFrJDSOmkN7hppO+y12ijmnZUQwUt/pUxvXod9M1A==',key_name='tempest-keypair-44416766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4bfa84ea3874ba7ac0af4c3b1d2f918',ramdisk_id='',reservation_id='r-ymzgl0l3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273596612',owner_user_name='tempest-TestVolumeBootPattern-273596612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:24:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbee62d1b15144cc9d433a4a64dd12a7',uuid=11e67339-be9e-481a-a8d2-8573caa97866,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1582c6d0-9518-41fa-907e-7c64af37731b", "address": "fa:16:3e:88:c5:08", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1582c6d0-95", "ovs_interfaceid": "1582c6d0-9518-41fa-907e-7c64af37731b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converting VIF {"id": "1582c6d0-9518-41fa-907e-7c64af37731b", "address": "fa:16:3e:88:c5:08", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1582c6d0-95", "ovs_interfaceid": "1582c6d0-9518-41fa-907e-7c64af37731b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:c5:08,bridge_name='br-int',has_traffic_filtering=True,id=1582c6d0-9518-41fa-907e-7c64af37731b,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1582c6d0-95') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG nova.objects.instance [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lazy-loading 'pci_devices' on Instance uuid 11e67339-be9e-481a-a8d2-8573caa97866 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:24:53 user nova-compute[75293]:   <uuid>11e67339-be9e-481a-a8d2-8573caa97866</uuid>
Nov 30 07:24:53 user nova-compute[75293]:   <name>instance-00000028</name>
Nov 30 07:24:53 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:24:53 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:24:53 user nova-compute[75293]:   <metadata>
Nov 30 07:24:53 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:24:53 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:24:53 user nova-compute[75293]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-499440655</nova:name>
Nov 30 07:24:53 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:24:51</nova:creationTime>
Nov 30 07:24:53 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:24:53 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:24:53 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:24:53 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:24:53 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:24:53 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:24:53 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:24:53 user nova-compute[75293]:       <nova:owner>
Nov 30 07:24:53 user nova-compute[75293]:         <nova:user uuid="fbee62d1b15144cc9d433a4a64dd12a7">tempest-TestVolumeBootPattern-273596612-project-member</nova:user>
Nov 30 07:24:53 user nova-compute[75293]:         <nova:project uuid="e4bfa84ea3874ba7ac0af4c3b1d2f918">tempest-TestVolumeBootPattern-273596612</nova:project>
Nov 30 07:24:53 user nova-compute[75293]:       </nova:owner>
Nov 30 07:24:53 user nova-compute[75293]:       <nova:ports>
Nov 30 07:24:53 user nova-compute[75293]:         <nova:port uuid="1582c6d0-9518-41fa-907e-7c64af37731b">
Nov 30 07:24:53 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 07:24:53 user nova-compute[75293]:         </nova:port>
Nov 30 07:24:53 user nova-compute[75293]:       </nova:ports>
Nov 30 07:24:53 user nova-compute[75293]:     </nova:instance>
Nov 30 07:24:53 user nova-compute[75293]:   </metadata>
Nov 30 07:24:53 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:24:53 user nova-compute[75293]:     <system>
Nov 30 07:24:53 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:24:53 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:24:53 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:24:53 user nova-compute[75293]:       <entry name="serial">11e67339-be9e-481a-a8d2-8573caa97866</entry>
Nov 30 07:24:53 user nova-compute[75293]:       <entry name="uuid">11e67339-be9e-481a-a8d2-8573caa97866</entry>
Nov 30 07:24:53 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:24:53 user nova-compute[75293]:     </system>
Nov 30 07:24:53 user nova-compute[75293]:   </sysinfo>
Nov 30 07:24:53 user nova-compute[75293]:   <os>
Nov 30 07:24:53 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:24:53 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:24:53 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:24:53 user nova-compute[75293]:   </os>
Nov 30 07:24:53 user nova-compute[75293]:   <features>
Nov 30 07:24:53 user nova-compute[75293]:     <acpi/>
Nov 30 07:24:53 user nova-compute[75293]:     <apic/>
Nov 30 07:24:53 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:24:53 user nova-compute[75293]:   </features>
Nov 30 07:24:53 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:24:53 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:24:53 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:24:53 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:24:53 user nova-compute[75293]:   </clock>
Nov 30 07:24:53 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:24:53 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:24:53 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:24:53 user nova-compute[75293]:   </cpu>
Nov 30 07:24:53 user nova-compute[75293]:   <devices>
Nov 30 07:24:53 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:24:53 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:24:53 user nova-compute[75293]:       <source dev="/dev/sde"/>
Nov 30 07:24:53 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:24:53 user nova-compute[75293]:       <serial>b09a17d0-b9a1-48df-a557-3114c31f831c</serial>
Nov 30 07:24:53 user nova-compute[75293]:     </disk>
Nov 30 07:24:53 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:24:53 user nova-compute[75293]:       <mac address="fa:16:3e:88:c5:08"/>
Nov 30 07:24:53 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:24:53 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:24:53 user nova-compute[75293]:       <target dev="tap1582c6d0-95"/>
Nov 30 07:24:53 user nova-compute[75293]:     </interface>
Nov 30 07:24:53 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:24:53 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/11e67339-be9e-481a-a8d2-8573caa97866/console.log" append="off"/>
Nov 30 07:24:53 user nova-compute[75293]:     </serial>
Nov 30 07:24:53 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:24:53 user nova-compute[75293]:     <video>
Nov 30 07:24:53 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:24:53 user nova-compute[75293]:     </video>
Nov 30 07:24:53 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:24:53 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:24:53 user nova-compute[75293]:     </rng>
Nov 30 07:24:53 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:24:53 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:24:53 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:24:53 user nova-compute[75293]:     </memballoon>
Nov 30 07:24:53 user nova-compute[75293]:   </devices>
Nov 30 07:24:53 user nova-compute[75293]: </domain>
Nov 30 07:24:53 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:24:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-499440655',display_name='tempest-TestVolumeBootPattern-volume-backed-server-499440655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-499440655',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdxGSQCpq3eCaS2wDTlAbV+wJ9939OUTl3NOz3PUxrF4CalT3ANXoFQsRDiODkeO9GbfLkFc34D1JdUPV8OkpoMwrFrJDSOmkN7hppO+y12ijmnZUQwUt/pUxvXod9M1A==',key_name='tempest-keypair-44416766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4bfa84ea3874ba7ac0af4c3b1d2f918',ramdisk_id='',reservation_id='r-ymzgl0l3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273596612',owner_user_name='tempest-TestVolumeBootPattern-273596612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:24:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbee62d1b15144cc9d433a4a64dd12a7',uuid=11e67339-be9e-481a-a8d2-8573caa97866,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1582c6d0-9518-41fa-907e-7c64af37731b", "address": "fa:16:3e:88:c5:08", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1582c6d0-95", "ovs_interfaceid": "1582c6d0-9518-41fa-907e-7c64af37731b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converting VIF {"id": "1582c6d0-9518-41fa-907e-7c64af37731b", "address": "fa:16:3e:88:c5:08", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1582c6d0-95", "ovs_interfaceid": "1582c6d0-9518-41fa-907e-7c64af37731b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:c5:08,bridge_name='br-int',has_traffic_filtering=True,id=1582c6d0-9518-41fa-907e-7c64af37731b,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1582c6d0-95') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG os_vif [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:c5:08,bridge_name='br-int',has_traffic_filtering=True,id=1582c6d0-9518-41fa-907e-7c64af37731b,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1582c6d0-95') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c17feee-861c-540c-a26f-a9076500f548', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1582c6d0-95, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1582c6d0-95, col_values=(('qos', UUID('a500ce02-9c4d-4d95-99db-c8c80a994b8b')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1582c6d0-95, col_values=(('external_ids', {'iface-id': '1582c6d0-9518-41fa-907e-7c64af37731b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:c5:08', 'vm-uuid': '11e67339-be9e-481a-a8d2-8573caa97866'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:53 user nova-compute[75293]: INFO os_vif [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:c5:08,bridge_name='br-int',has_traffic_filtering=True,id=1582c6d0-9518-41fa-907e-7c64af37731b,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1582c6d0-95')
Nov 30 07:24:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:24:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] No VIF found with MAC fa:16:3e:88:c5:08, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:24:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:55 user nova-compute[75293]: DEBUG nova.compute.manager [req-2a4c838c-9bb7-4971-ac89-885819e8a794 req-e393c9f0-5ff9-44a2-b703-518d48d97747 service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Received event network-vif-plugged-1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:24:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2a4c838c-9bb7-4971-ac89-885819e8a794 req-e393c9f0-5ff9-44a2-b703-518d48d97747 service nova] Acquiring lock "11e67339-be9e-481a-a8d2-8573caa97866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2a4c838c-9bb7-4971-ac89-885819e8a794 req-e393c9f0-5ff9-44a2-b703-518d48d97747 service nova] Lock "11e67339-be9e-481a-a8d2-8573caa97866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2a4c838c-9bb7-4971-ac89-885819e8a794 req-e393c9f0-5ff9-44a2-b703-518d48d97747 service nova] Lock "11e67339-be9e-481a-a8d2-8573caa97866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:55 user nova-compute[75293]: DEBUG nova.compute.manager [req-2a4c838c-9bb7-4971-ac89-885819e8a794 req-e393c9f0-5ff9-44a2-b703-518d48d97747 service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] No waiting events found dispatching network-vif-plugged-1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:24:55 user nova-compute[75293]: WARNING nova.compute.manager [req-2a4c838c-9bb7-4971-ac89-885819e8a794 req-e393c9f0-5ff9-44a2-b703-518d48d97747 service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Received unexpected event network-vif-plugged-1582c6d0-9518-41fa-907e-7c64af37731b for instance with vm_state building and task_state spawning.
Nov 30 07:24:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:24:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:24:56 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:24:57 user nova-compute[75293]: DEBUG nova.compute.manager [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:24:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:24:57 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Instance spawned successfully.
Nov 30 07:24:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:24:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:24:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:24:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:24:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:24:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:24:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:24:57 user nova-compute[75293]: INFO nova.compute.manager [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Took 6.09 seconds to spawn the instance on the hypervisor.
Nov 30 07:24:57 user nova-compute[75293]: DEBUG nova.compute.manager [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:24:57 user nova-compute[75293]: INFO nova.compute.manager [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Took 15.34 seconds to build instance.
Nov 30 07:24:57 user nova-compute[75293]: DEBUG nova.compute.manager [req-714bbe61-7830-4f6b-b931-c7712f355114 req-61ae7062-d209-4351-892e-83e105e1ed0e service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Received event network-vif-plugged-1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:24:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-714bbe61-7830-4f6b-b931-c7712f355114 req-61ae7062-d209-4351-892e-83e105e1ed0e service nova] Acquiring lock "11e67339-be9e-481a-a8d2-8573caa97866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-714bbe61-7830-4f6b-b931-c7712f355114 req-61ae7062-d209-4351-892e-83e105e1ed0e service nova] Lock "11e67339-be9e-481a-a8d2-8573caa97866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-714bbe61-7830-4f6b-b931-c7712f355114 req-61ae7062-d209-4351-892e-83e105e1ed0e service nova] Lock "11e67339-be9e-481a-a8d2-8573caa97866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:57 user nova-compute[75293]: DEBUG nova.compute.manager [req-714bbe61-7830-4f6b-b931-c7712f355114 req-61ae7062-d209-4351-892e-83e105e1ed0e service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] No waiting events found dispatching network-vif-plugged-1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:24:57 user nova-compute[75293]: WARNING nova.compute.manager [req-714bbe61-7830-4f6b-b931-c7712f355114 req-61ae7062-d209-4351-892e-83e105e1ed0e service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Received unexpected event network-vif-plugged-1582c6d0-9518-41fa-907e-7c64af37731b for instance with vm_state active and task_state None.
Nov 30 07:24:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-45846f58-1581-484f-a717-cf1b2f21decb tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "11e67339-be9e-481a-a8d2-8573caa97866" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.445s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:24:58 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:24:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:24:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:24:58 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:24:58 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:24:58 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:24:58 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:24:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:24:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:24:59 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:00 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:25:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:00 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:01 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:25:01 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:25:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=8000MB free_disk=24.977375030517578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:25:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance c8d1df78-2aa2-4710-a570-5f72c60cfc26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:25:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:25:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 4ebf0be9-15e0-418c-a554-7885c79a725b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:25:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 54c60b45-04dc-4d3b-96ec-c2d0f583cafa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:25:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance d89452ef-96ab-4081-bc40-0f64968de367 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:25:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance e67ad73a-2c4b-4cfe-acc5-e62d95d09318 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:25:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 47068cdd-7fbb-4612-892e-bfdccdac9cbd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:25:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 11e67339-be9e-481a-a8d2-8573caa97866 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:25:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:25:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:25:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:01 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:25:01 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:25:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:25:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:02 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4ebf0be9-15e0-418c-a554-7885c79a725b is timed out.
Nov 30 07:25:02 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Successfully detached device vdb from instance 4ebf0be9-15e0-418c-a554-7885c79a725b from the live domain config.
Nov 30 07:25:02 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmeIDlRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:25:02 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:25:02 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9a478e-328a-49f5-8b05-df1287b5373f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:25:02 user nova-compute[75293]: No targets found.
Nov 30 07:25:02 user nova-compute[75293]: iSNS:
Nov 30 07:25:02 user nova-compute[75293]: No targets found.
Nov 30 07:25:02 user nova-compute[75293]: STATIC:
Nov 30 07:25:02 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e
Nov 30 07:25:02 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:25:02 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:25:02 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:25:02 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:25:02 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:25:02 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea
Nov 30 07:25:02 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:25:02 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:25:02 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c
Nov 30 07:25:02 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:25:02 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:25:02 user nova-compute[75293]: FIRMWARE:
Nov 30 07:25:02 user nova-compute[75293]: No targets found.
Nov 30 07:25:02 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:25:02 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:25:02 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[644712e8-6ce9-47fd-999c-f2eef0d27f3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1be5542-ace6-472e-89aa-cd8f6230476f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:25:02 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:25:02 user nova-compute[75293]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e (non-flash)
Nov 30 07:25:02 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:25:02 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:25:02 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:25:02 user nova-compute[75293]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e (non-flash)
Nov 30 07:25:02 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:25:02 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effc87bd090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e'): ({'sdc'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Removing single pathed devices sdc {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74df04d-d97e-474c-b5c0-ee7601ead8d6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fa420c-b147-433d-978c-c5dfdad196a1]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Flushing IO for device /dev/sdc {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5755a4-e588-4fa2-881d-8b1f9f5df63f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8938bbe1-e0a0-4253-88ff-b24444ebabc7]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:25:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d86d33-7834-42d9-8296-28005d139ce0]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[31db5892-2f85-4570-be83-56b7143eca8d]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e, portal: 172.16.0.220,3260]
Nov 30 07:25:03 user nova-compute[75293]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e, portal: 172.16.0.220,3260] successful.
Nov 30 07:25:03 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4240643-5f50-4faa-9310-d330497d477e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03dddeb-87c6-45f3-b26d-816a57395926]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] <== disconnect_volume: return (315ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Rebuilding the list of instances to heal {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG nova.objects.instance [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lazy-loading 'flavor' on Instance uuid 4ebf0be9-15e0-418c-a554-7885c79a725b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-c8d1df78-2aa2-4710-a570-5f72c60cfc26" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-c8d1df78-2aa2-4710-a570-5f72c60cfc26" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lazy-loading 'info_cache' on Instance uuid c8d1df78-2aa2-4710-a570-5f72c60cfc26 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:25:03 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-732929b0-1a00-4c18-aa30-993ab386eafc tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.698s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:04 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Updating instance_info_cache with network_info: [{"id": "66299713-0237-47db-9fef-e5816beed9d9", "address": "fa:16:3e:db:c2:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66299713-02", "ovs_interfaceid": "66299713-0237-47db-9fef-e5816beed9d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:25:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-c8d1df78-2aa2-4710-a570-5f72c60cfc26" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:25:04 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:25:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:25:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:25:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:25:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:05 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:25:05 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:25:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:25:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75293) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 07:25:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:25:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:25:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "d89452ef-96ab-4081-bc40-0f64968de367" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "d89452ef-96ab-4081-bc40-0f64968de367" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG nova.objects.instance [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lazy-loading 'flavor' on Instance uuid d89452ef-96ab-4081-bc40-0f64968de367 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "d89452ef-96ab-4081-bc40-0f64968de367" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.345s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "d89452ef-96ab-4081-bc40-0f64968de367" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "d89452ef-96ab-4081-bc40-0f64968de367" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:26 user nova-compute[75293]: INFO nova.compute.manager [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Attaching volume 9e982db5-ba1e-4b95-a127-1b44b7d7c6cf to /dev/vdb
Nov 30 07:25:26 user nova-compute[75293]: DEBUG os_brick.utils [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[459072ee-4b97-4859-b819-422087fdd760]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b356419-1854-413a-b388-b9a63c65d401]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7579e7d-1af6-484c-9a31-dca8328ad98e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dddc5e-b870-4c40-b36c-856132ef4920]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:25:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:25:27 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:25:27 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d1938b-0b1b-4394-bebb-80afad3cee94]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:25:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:25:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:25:27 user nova-compute[75293]: DEBUG os_brick.utils [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:25:27 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Updating existing volume attachment record: 6bd906f9-4815-47e9-80e3-b546577d3fd6 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:25:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvteRwNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:25:35 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:25:35 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:25:35 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fb2b0a-9531-446f-a737-0deebe08b11b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:25:35 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ee9670-02c5-421d-b18e-8e61f9d1e27f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf] added
Nov 30 07:25:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[690d51f5-92f2-477e-901a-9daa10c56151]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e155cd33-c5fe-41a5-bc19-0e7c7c60c907]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dvteRwNq {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dvteRwNq" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2083b9a4-654c-46d4-bb91-f4fd71aa7ebf]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dvteRwNq'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4815ae-226e-4092-95c8-8ccaea099516]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c01d9ef-a672-4eb3-90fb-2ba9ec329c2e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:25:35 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:25:35 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:25:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:25:35 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:25:35 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:25:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d1e4a5-c43f-422d-84b9-05e7312c0285]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260]
Nov 30 07:25:35 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260] successful.
Nov 30 07:25:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5478a6-8080-46c3-b582-1aa48dd5412c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9911ce8-48f0-435b-bad5-b31d496448ad]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:25:35 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:25:35 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:25:35 user nova-compute[75293]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:25:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:25:35 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:25:35 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:25:35 user nova-compute[75293]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:25:35 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f043f8-2240-4e8a-9d08-2d8cc5b166a4]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:25:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvteRwNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:25:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:25:36 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23831383437346332', 'path': '/dev/sdc'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:25:36 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831383437346332', 'path': '/dev/sdc'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:25:36 user nova-compute[75293]: DEBUG nova.objects.instance [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lazy-loading 'flavor' on Instance uuid d89452ef-96ab-4081-bc40-0f64968de367 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:25:36 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:25:36 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:25:36 user nova-compute[75293]:   <source dev="/dev/sdc"/>
Nov 30 07:25:36 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:25:36 user nova-compute[75293]:   <serial>9e982db5-ba1e-4b95-a127-1b44b7d7c6cf</serial>
Nov 30 07:25:36 user nova-compute[75293]: </disk>
Nov 30 07:25:36 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:25:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:25:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:25:37 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] No VIF found with MAC fa:16:3e:8c:ff:ac, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:25:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3f278aae-4f08-47a4-8495-66e2c1af5c8a tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "d89452ef-96ab-4081-bc40-0f64968de367" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.484s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:25:39 user nova-compute[75293]: DEBUG nova.compute.manager [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Stashing vm_state: active {{(pid=75293) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 30 07:25:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:39 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:25:39 user nova-compute[75293]: INFO nova.compute.claims [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Claim successful on node user
Nov 30 07:25:39 user nova-compute[75293]: INFO nova.compute.resource_tracker [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Updating resource usage from migration 6830e03e-45db-4f4e-a180-42a1c39448d1
Nov 30 07:25:40 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:25:40 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:25:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.453s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:40 user nova-compute[75293]: INFO nova.compute.manager [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Migrating
Nov 30 07:25:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:25:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:25:40 user nova-compute[75293]: INFO nova.compute.rpcapi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 30 07:25:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:25:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:25:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquired lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:25:40 user nova-compute[75293]: DEBUG nova.network.neutron [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:25:40 user nova-compute[75293]: DEBUG nova.network.neutron [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Updating instance_info_cache with network_info: [{"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Releasing lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "2e215797-58b6-47bb-acbc-edd77e6cca2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG nova.compute.manager [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Starting migrate_disk_and_power_off {{(pid=75293) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:25:41 user nova-compute[75293]: INFO nova.compute.claims [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Claim successful on node user
Nov 30 07:25:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG nova.compute.manager [req-515ace9d-7fc6-4af3-91e3-93d58dd08e5d req-d8039767-8d2f-41d5-85f4-310a193dd5aa service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received event network-vif-unplugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-515ace9d-7fc6-4af3-91e3-93d58dd08e5d req-d8039767-8d2f-41d5-85f4-310a193dd5aa service nova] Acquiring lock "d89452ef-96ab-4081-bc40-0f64968de367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-515ace9d-7fc6-4af3-91e3-93d58dd08e5d req-d8039767-8d2f-41d5-85f4-310a193dd5aa service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-515ace9d-7fc6-4af3-91e3-93d58dd08e5d req-d8039767-8d2f-41d5-85f4-310a193dd5aa service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG nova.compute.manager [req-515ace9d-7fc6-4af3-91e3-93d58dd08e5d req-d8039767-8d2f-41d5-85f4-310a193dd5aa service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] No waiting events found dispatching network-vif-unplugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:25:41 user nova-compute[75293]: WARNING nova.compute.manager [req-515ace9d-7fc6-4af3-91e3-93d58dd08e5d req-d8039767-8d2f-41d5-85f4-310a193dd5aa service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received unexpected event network-vif-unplugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 for instance with vm_state active and task_state resize_migrating.
Nov 30 07:25:41 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG nova.compute.manager [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG nova.compute.manager [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG nova.network.neutron [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:25:41 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:25:41 user nova-compute[75293]: DEBUG nova.compute.manager [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:25:41 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Instance destroyed successfully.
Nov 30 07:25:41 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1953113672',display_name='tempest-ServerActionsTestOtherB-server-1953113672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1953113672',id=35,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnRjCaWy780if2CkUOoZrcrdcD+P1g/YJnFZ7z8Y8pV7AT42ymHjcVO5HJTfrEuy5cWDNDXLYAnT+pwSMKRHRG0FXx2bJrOk/qq7N46wXruznAxyX6mXSnteMjD8Ewz6w==',key_name='tempest-keypair-319510887',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:21:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2e631f0d47cc43a1b670e1b78b482e67',ramdisk_id='',reservation_id='r-mjklwfn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-70269142',owner_user_name='tempest-ServerActionsTestOtherB-70269142-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:25:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fb08d8e90be4f6eb2efd21f2cbf2dcd',uuid=d89452ef-96ab-4081-bc40-0f64968de367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-235837065-network", "vif_mac": "fa:16:3e:8c:ff:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Converting VIF {"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-235837065-network", "vif_mac": "fa:16:3e:8c:ff:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG os_vif [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b9bbab7-78, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e20e843e-79d5-4700-a83d-069e3096cd0f) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:41 user nova-compute[75293]: INFO os_vif [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78')
Nov 30 07:25:41 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvteRwNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:25:41 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:25:41 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62a838b-8af3-47b3-9d46-b71ae81e9ee4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:25:41 user nova-compute[75293]: No targets found.
Nov 30 07:25:41 user nova-compute[75293]: iSNS:
Nov 30 07:25:41 user nova-compute[75293]: No targets found.
Nov 30 07:25:41 user nova-compute[75293]: STATIC:
Nov 30 07:25:41 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:25:41 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:25:41 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:25:41 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea
Nov 30 07:25:41 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:25:41 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:25:41 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c
Nov 30 07:25:41 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:25:41 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:25:41 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf
Nov 30 07:25:41 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:25:41 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:25:41 user nova-compute[75293]: FIRMWARE:
Nov 30 07:25:41 user nova-compute[75293]: No targets found.
Nov 30 07:25:41 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:25:41 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:25:41 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:25:41 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[65286b90-e6e4-44a3-b52d-03b555a9335a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG nova.policy [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abe34a1b2c38472d831ae5d7afa85c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ff34b2e2c047319c1fe166c5029790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bfa26b-ce45-468d-81e2-c2c097c01125]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:25:42 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:25:42 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:25:42 user nova-compute[75293]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:25:42 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:25:42 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:25:42 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:25:42 user nova-compute[75293]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:25:42 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effc8680670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf'): ({'sdc'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Removing single pathed devices sdc {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG nova.compute.manager [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:25:42 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Creating image(s)
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "/opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "/opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c779f865-483c-4033-804d-b3fd5f3e87e2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.032s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[433e4758-5a0e-4297-9918-3f1fbf52ff64]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Flushing IO for device /dev/sdc {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[505f945f-4217-40c0-8657-3efa7a906284]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.068s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[401d55c8-a599-4f48-97fa-32dfe785b95e]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.074s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ae055e-4eca-4c16-b703-0c9773b2eba7]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.330s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.192s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af05dfa-d024-4367-915c-9f84c5d93121]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260]
Nov 30 07:25:42 user nova-compute[75293]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260] successful.
Nov 30 07:25:42 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03c3537-f4b7-467f-90d0-7cc5370061d9]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.602s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] <== disconnect_volume: return (604ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.186s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk 1073741824" returned: 0 in 0.237s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.428s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:42 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.238s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367_resize/disk /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Cannot resize image /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Ensure instance console log exists: /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG nova.network.neutron [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Successfully created port: 9ff82ba5-78d7-420b-b9b3-b045ed2dcefd {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CMD "cp -r /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367_resize/disk /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk" returned: 0 in 0.258s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367_resize/disk.info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk.info {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CMD "cp -r /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367_resize/disk.info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk.info" returned: 0 in 0.036s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-924c9095-e266-4388-aec6-ed76af7476e6 req-f4cf4f07-822d-4d1e-848b-f24aeffba6c5 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received event network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-924c9095-e266-4388-aec6-ed76af7476e6 req-f4cf4f07-822d-4d1e-848b-f24aeffba6c5 service nova] Acquiring lock "d89452ef-96ab-4081-bc40-0f64968de367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-924c9095-e266-4388-aec6-ed76af7476e6 req-f4cf4f07-822d-4d1e-848b-f24aeffba6c5 service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-924c9095-e266-4388-aec6-ed76af7476e6 req-f4cf4f07-822d-4d1e-848b-f24aeffba6c5 service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-924c9095-e266-4388-aec6-ed76af7476e6 req-f4cf4f07-822d-4d1e-848b-f24aeffba6c5 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] No waiting events found dispatching network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:25:43 user nova-compute[75293]: WARNING nova.compute.manager [req-924c9095-e266-4388-aec6-ed76af7476e6 req-f4cf4f07-822d-4d1e-848b-f24aeffba6c5 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received unexpected event network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 for instance with vm_state active and task_state resize_migrating.
Nov 30 07:25:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.network.neutron [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Successfully updated port: 9ff82ba5-78d7-420b-b9b3-b045ed2dcefd {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "refresh_cache-2e215797-58b6-47bb-acbc-edd77e6cca2d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquired lock "refresh_cache-2e215797-58b6-47bb-acbc-edd77e6cca2d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.network.neutron [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.network.neutron [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.network.neutron [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Updating instance_info_cache with network_info: [{"id": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "address": "fa:16:3e:e6:ca:88", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff82ba5-78", "ovs_interfaceid": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Releasing lock "refresh_cache-2e215797-58b6-47bb-acbc-edd77e6cca2d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.compute.manager [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Instance network_info: |[{"id": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "address": "fa:16:3e:e6:ca:88", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff82ba5-78", "ovs_interfaceid": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Start _get_guest_xml network_info=[{"id": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "address": "fa:16:3e:e6:ca:88", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff82ba5-78", "ovs_interfaceid": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:25:44 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:25:44 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-554807482',display_name='tempest-AttachVolumeNegativeTest-server-554807482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-554807482',id=41,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0+bavRR221GVEQCkkD461W5sIzD+nROEEDkS8aS8Bs0wX9A3tA7ljoZF416OTrr9/Tv1weM71H/rcAeOpv+L4otgmteVAxvZlPsnhoEUZgeCIbacARUJi5CzquMJ133A==',key_name='tempest-keypair-1952980149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68ff34b2e2c047319c1fe166c5029790',ramdisk_id='',reservation_id='r-tmet18bu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1915468397',owner_user_name='tempest-AttachVolumeNegativeTest-1915468397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:25:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe34a1b2c38472d831ae5d7afa85c77',uuid=2e215797-58b6-47bb-acbc-edd77e6cca2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "address": "fa:16:3e:e6:ca:88", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff82ba5-78", "ovs_interfaceid": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converting VIF {"id": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "address": "fa:16:3e:e6:ca:88", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff82ba5-78", "ovs_interfaceid": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ca:88,bridge_name='br-int',has_traffic_filtering=True,id=9ff82ba5-78d7-420b-b9b3-b045ed2dcefd,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff82ba5-78') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.objects.instance [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e215797-58b6-47bb-acbc-edd77e6cca2d {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.network.neutron [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Port 0b9bbab7-780f-4b09-9c9b-4448e8ff2323 binding to destination host user is already ACTIVE {{(pid=75293) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:25:44 user nova-compute[75293]:   <uuid>2e215797-58b6-47bb-acbc-edd77e6cca2d</uuid>
Nov 30 07:25:44 user nova-compute[75293]:   <name>instance-00000029</name>
Nov 30 07:25:44 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:25:44 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:25:44 user nova-compute[75293]:   <metadata>
Nov 30 07:25:44 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:25:44 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:25:44 user nova-compute[75293]:       <nova:name>tempest-AttachVolumeNegativeTest-server-554807482</nova:name>
Nov 30 07:25:44 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:25:44</nova:creationTime>
Nov 30 07:25:44 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:25:44 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:25:44 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:25:44 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:25:44 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:25:44 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:25:44 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:25:44 user nova-compute[75293]:       <nova:owner>
Nov 30 07:25:44 user nova-compute[75293]:         <nova:user uuid="abe34a1b2c38472d831ae5d7afa85c77">tempest-AttachVolumeNegativeTest-1915468397-project-member</nova:user>
Nov 30 07:25:44 user nova-compute[75293]:         <nova:project uuid="68ff34b2e2c047319c1fe166c5029790">tempest-AttachVolumeNegativeTest-1915468397</nova:project>
Nov 30 07:25:44 user nova-compute[75293]:       </nova:owner>
Nov 30 07:25:44 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:25:44 user nova-compute[75293]:       <nova:ports>
Nov 30 07:25:44 user nova-compute[75293]:         <nova:port uuid="9ff82ba5-78d7-420b-b9b3-b045ed2dcefd">
Nov 30 07:25:44 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 07:25:44 user nova-compute[75293]:         </nova:port>
Nov 30 07:25:44 user nova-compute[75293]:       </nova:ports>
Nov 30 07:25:44 user nova-compute[75293]:     </nova:instance>
Nov 30 07:25:44 user nova-compute[75293]:   </metadata>
Nov 30 07:25:44 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:25:44 user nova-compute[75293]:     <system>
Nov 30 07:25:44 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:25:44 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:25:44 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:25:44 user nova-compute[75293]:       <entry name="serial">2e215797-58b6-47bb-acbc-edd77e6cca2d</entry>
Nov 30 07:25:44 user nova-compute[75293]:       <entry name="uuid">2e215797-58b6-47bb-acbc-edd77e6cca2d</entry>
Nov 30 07:25:44 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:25:44 user nova-compute[75293]:     </system>
Nov 30 07:25:44 user nova-compute[75293]:   </sysinfo>
Nov 30 07:25:44 user nova-compute[75293]:   <os>
Nov 30 07:25:44 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:25:44 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:25:44 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:25:44 user nova-compute[75293]:   </os>
Nov 30 07:25:44 user nova-compute[75293]:   <features>
Nov 30 07:25:44 user nova-compute[75293]:     <acpi/>
Nov 30 07:25:44 user nova-compute[75293]:     <apic/>
Nov 30 07:25:44 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:25:44 user nova-compute[75293]:   </features>
Nov 30 07:25:44 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:25:44 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:25:44 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:25:44 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:25:44 user nova-compute[75293]:   </clock>
Nov 30 07:25:44 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:25:44 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:25:44 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:25:44 user nova-compute[75293]:   </cpu>
Nov 30 07:25:44 user nova-compute[75293]:   <devices>
Nov 30 07:25:44 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:25:44 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:25:44 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk"/>
Nov 30 07:25:44 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:25:44 user nova-compute[75293]:     </disk>
Nov 30 07:25:44 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:25:44 user nova-compute[75293]:       <mac address="fa:16:3e:e6:ca:88"/>
Nov 30 07:25:44 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:25:44 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:25:44 user nova-compute[75293]:       <target dev="tap9ff82ba5-78"/>
Nov 30 07:25:44 user nova-compute[75293]:     </interface>
Nov 30 07:25:44 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:25:44 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/console.log" append="off"/>
Nov 30 07:25:44 user nova-compute[75293]:     </serial>
Nov 30 07:25:44 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:25:44 user nova-compute[75293]:     <video>
Nov 30 07:25:44 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:25:44 user nova-compute[75293]:     </video>
Nov 30 07:25:44 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:25:44 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:25:44 user nova-compute[75293]:     </rng>
Nov 30 07:25:44 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:25:44 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:25:44 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:25:44 user nova-compute[75293]:     </memballoon>
Nov 30 07:25:44 user nova-compute[75293]:   </devices>
Nov 30 07:25:44 user nova-compute[75293]: </domain>
Nov 30 07:25:44 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-554807482',display_name='tempest-AttachVolumeNegativeTest-server-554807482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-554807482',id=41,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0+bavRR221GVEQCkkD461W5sIzD+nROEEDkS8aS8Bs0wX9A3tA7ljoZF416OTrr9/Tv1weM71H/rcAeOpv+L4otgmteVAxvZlPsnhoEUZgeCIbacARUJi5CzquMJ133A==',key_name='tempest-keypair-1952980149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68ff34b2e2c047319c1fe166c5029790',ramdisk_id='',reservation_id='r-tmet18bu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1915468397',owner_user_name='tempest-AttachVolumeNegativeTest-1915468397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:25:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe34a1b2c38472d831ae5d7afa85c77',uuid=2e215797-58b6-47bb-acbc-edd77e6cca2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "address": "fa:16:3e:e6:ca:88", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff82ba5-78", "ovs_interfaceid": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converting VIF {"id": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "address": "fa:16:3e:e6:ca:88", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff82ba5-78", "ovs_interfaceid": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ca:88,bridge_name='br-int',has_traffic_filtering=True,id=9ff82ba5-78d7-420b-b9b3-b045ed2dcefd,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff82ba5-78') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG os_vif [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ca:88,bridge_name='br-int',has_traffic_filtering=True,id=9ff82ba5-78d7-420b-b9b3-b045ed2dcefd,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff82ba5-78') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a78c7f5-848d-59d3-b15c-1bed4149f2bf', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ff82ba5-78, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ff82ba5-78, col_values=(('qos', UUID('87fb6f1b-2a31-4751-9681-62886b6ff7a4')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ff82ba5-78, col_values=(('external_ids', {'iface-id': '9ff82ba5-78d7-420b-b9b3-b045ed2dcefd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:ca:88', 'vm-uuid': '2e215797-58b6-47bb-acbc-edd77e6cca2d'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:25:44 user nova-compute[75293]: INFO os_vif [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ca:88,bridge_name='br-int',has_traffic_filtering=True,id=9ff82ba5-78d7-420b-b9b3-b045ed2dcefd,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff82ba5-78')
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] No VIF found with MAC fa:16:3e:e6:ca:88, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "d89452ef-96ab-4081-bc40-0f64968de367-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquired lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:25:44 user nova-compute[75293]: DEBUG nova.network.neutron [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG nova.network.neutron [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Updating instance_info_cache with network_info: [{"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Releasing lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG os_brick.utils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8e3832-276e-42d6-8d81-7c02874ce350]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d25d7e8-be1a-4dd6-83c7-5c2b2eb655cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71895a1-eccf-432e-806a-579099d4a576]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f176c90-c53a-40ad-a7bf-29734df19213]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:25:45 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:25:45 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6497c3-b288-4d6d-a672-16d7deb2f00f]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG os_brick.utils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG nova.compute.manager [req-d9e89729-06b0-410e-943a-f23160a868a4 req-04385a7f-c69e-4a9f-9164-c5c772d1da6d service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Received event network-changed-9ff82ba5-78d7-420b-b9b3-b045ed2dcefd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG nova.compute.manager [req-d9e89729-06b0-410e-943a-f23160a868a4 req-04385a7f-c69e-4a9f-9164-c5c772d1da6d service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Refreshing instance network info cache due to event network-changed-9ff82ba5-78d7-420b-b9b3-b045ed2dcefd. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d9e89729-06b0-410e-943a-f23160a868a4 req-04385a7f-c69e-4a9f-9164-c5c772d1da6d service nova] Acquiring lock "refresh_cache-2e215797-58b6-47bb-acbc-edd77e6cca2d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d9e89729-06b0-410e-943a-f23160a868a4 req-04385a7f-c69e-4a9f-9164-c5c772d1da6d service nova] Acquired lock "refresh_cache-2e215797-58b6-47bb-acbc-edd77e6cca2d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG nova.network.neutron [req-d9e89729-06b0-410e-943a-f23160a868a4 req-04385a7f-c69e-4a9f-9164-c5c772d1da6d service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Refreshing network info cache for port 9ff82ba5-78d7-420b-b9b3-b045ed2dcefd {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:46 user nova-compute[75293]: DEBUG nova.network.neutron [req-d9e89729-06b0-410e-943a-f23160a868a4 req-04385a7f-c69e-4a9f-9164-c5c772d1da6d service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Updated VIF entry in instance network info cache for port 9ff82ba5-78d7-420b-b9b3-b045ed2dcefd. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:25:46 user nova-compute[75293]: DEBUG nova.network.neutron [req-d9e89729-06b0-410e-943a-f23160a868a4 req-04385a7f-c69e-4a9f-9164-c5c772d1da6d service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Updating instance_info_cache with network_info: [{"id": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "address": "fa:16:3e:e6:ca:88", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff82ba5-78", "ovs_interfaceid": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:25:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d9e89729-06b0-410e-943a-f23160a868a4 req-04385a7f-c69e-4a9f-9164-c5c772d1da6d service nova] Releasing lock "refresh_cache-2e215797-58b6-47bb-acbc-edd77e6cca2d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:25:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-cb4884f4-0402-4c42-bcf5-91e981943430 req-cf0a0789-7ce7-4658-9f4e-583e0653029b service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Received event network-vif-plugged-9ff82ba5-78d7-420b-b9b3-b045ed2dcefd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:25:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cb4884f4-0402-4c42-bcf5-91e981943430 req-cf0a0789-7ce7-4658-9f4e-583e0653029b service nova] Acquiring lock "2e215797-58b6-47bb-acbc-edd77e6cca2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cb4884f4-0402-4c42-bcf5-91e981943430 req-cf0a0789-7ce7-4658-9f4e-583e0653029b service nova] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cb4884f4-0402-4c42-bcf5-91e981943430 req-cf0a0789-7ce7-4658-9f4e-583e0653029b service nova] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-cb4884f4-0402-4c42-bcf5-91e981943430 req-cf0a0789-7ce7-4658-9f4e-583e0653029b service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] No waiting events found dispatching network-vif-plugged-9ff82ba5-78d7-420b-b9b3-b045ed2dcefd {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:25:47 user nova-compute[75293]: WARNING nova.compute.manager [req-cb4884f4-0402-4c42-bcf5-91e981943430 req-cf0a0789-7ce7-4658-9f4e-583e0653029b service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Received unexpected event network-vif-plugged-9ff82ba5-78d7-420b-b9b3-b045ed2dcefd for instance with vm_state building and task_state spawning.
Nov 30 07:25:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-cb4884f4-0402-4c42-bcf5-91e981943430 req-cf0a0789-7ce7-4658-9f4e-583e0653029b service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Received event network-vif-plugged-9ff82ba5-78d7-420b-b9b3-b045ed2dcefd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:25:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cb4884f4-0402-4c42-bcf5-91e981943430 req-cf0a0789-7ce7-4658-9f4e-583e0653029b service nova] Acquiring lock "2e215797-58b6-47bb-acbc-edd77e6cca2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cb4884f4-0402-4c42-bcf5-91e981943430 req-cf0a0789-7ce7-4658-9f4e-583e0653029b service nova] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-cb4884f4-0402-4c42-bcf5-91e981943430 req-cf0a0789-7ce7-4658-9f4e-583e0653029b service nova] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-cb4884f4-0402-4c42-bcf5-91e981943430 req-cf0a0789-7ce7-4658-9f4e-583e0653029b service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] No waiting events found dispatching network-vif-plugged-9ff82ba5-78d7-420b-b9b3-b045ed2dcefd {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:25:47 user nova-compute[75293]: WARNING nova.compute.manager [req-cb4884f4-0402-4c42-bcf5-91e981943430 req-cf0a0789-7ce7-4658-9f4e-583e0653029b service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Received unexpected event network-vif-plugged-9ff82ba5-78d7-420b-b9b3-b045ed2dcefd for instance with vm_state building and task_state spawning.
Nov 30 07:25:48 user nova-compute[75293]: DEBUG nova.compute.manager [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:25:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:25:48 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Instance spawned successfully.
Nov 30 07:25:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:25:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:25:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:25:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:25:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:25:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:25:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:25:48 user nova-compute[75293]: INFO nova.compute.manager [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Took 6.34 seconds to spawn the instance on the hypervisor.
Nov 30 07:25:48 user nova-compute[75293]: DEBUG nova.compute.manager [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:25:48 user nova-compute[75293]: INFO nova.compute.manager [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Took 7.28 seconds to build instance.
Nov 30 07:25:48 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-3cf16ecb-f3e9-4ba9-934b-406a20540311 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.397s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:51 user nova-compute[75293]: INFO nova.compute.manager [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Rescuing
Nov 30 07:25:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "refresh_cache-e67ad73a-2c4b-4cfe-acc5-e62d95d09318" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:25:51 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquired lock "refresh_cache-e67ad73a-2c4b-4cfe-acc5-e62d95d09318" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:25:51 user nova-compute[75293]: DEBUG nova.network.neutron [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:25:52 user nova-compute[75293]: DEBUG nova.network.neutron [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Updating instance_info_cache with network_info: [{"id": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "address": "fa:16:3e:80:e5:cd", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce63f6a4-44", "ovs_interfaceid": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:25:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Releasing lock "refresh_cache-e67ad73a-2c4b-4cfe-acc5-e62d95d09318" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:25:52 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:52 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:52 user nova-compute[75293]: DEBUG nova.compute.manager [req-2ec9867c-92f7-4dc0-a161-52eba7927996 req-fe5dd7af-7c6b-4fcc-8c75-0ac6f8015460 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received event network-vif-unplugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:25:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2ec9867c-92f7-4dc0-a161-52eba7927996 req-fe5dd7af-7c6b-4fcc-8c75-0ac6f8015460 service nova] Acquiring lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2ec9867c-92f7-4dc0-a161-52eba7927996 req-fe5dd7af-7c6b-4fcc-8c75-0ac6f8015460 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2ec9867c-92f7-4dc0-a161-52eba7927996 req-fe5dd7af-7c6b-4fcc-8c75-0ac6f8015460 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:52 user nova-compute[75293]: DEBUG nova.compute.manager [req-2ec9867c-92f7-4dc0-a161-52eba7927996 req-fe5dd7af-7c6b-4fcc-8c75-0ac6f8015460 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] No waiting events found dispatching network-vif-unplugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:25:52 user nova-compute[75293]: WARNING nova.compute.manager [req-2ec9867c-92f7-4dc0-a161-52eba7927996 req-fe5dd7af-7c6b-4fcc-8c75-0ac6f8015460 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received unexpected event network-vif-unplugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 for instance with vm_state active and task_state rescuing.
Nov 30 07:25:52 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:52 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:53 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Instance destroyed successfully.
Nov 30 07:25:53 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Attempting a stable device rescue
Nov 30 07:25:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75293) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 07:25:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Instance directory exists: not creating {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 07:25:53 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Creating image(s)
Nov 30 07:25:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "/opt/stack/data/nova/instances/e67ad73a-2c4b-4cfe-acc5-e62d95d09318/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "/opt/stack/data/nova/instances/e67ad73a-2c4b-4cfe-acc5-e62d95d09318/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.005s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "/opt/stack/data/nova/instances/e67ad73a-2c4b-4cfe-acc5-e62d95d09318/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:53 user nova-compute[75293]: DEBUG nova.objects.instance [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'trusted_certs' on Instance uuid e67ad73a-2c4b-4cfe-acc5-e62d95d09318 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:25:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "4c34ba0c1050eacf7446cacd7e277652c4ed8cc2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "4c34ba0c1050eacf7446cacd7e277652c4ed8cc2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.011s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c34ba0c1050eacf7446cacd7e277652c4ed8cc2.part --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG nova.compute.manager [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] Acquiring lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG nova.compute.manager [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] No waiting events found dispatching network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:25:54 user nova-compute[75293]: WARNING nova.compute.manager [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received unexpected event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 for instance with vm_state active and task_state rescuing.
Nov 30 07:25:54 user nova-compute[75293]: DEBUG nova.compute.manager [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] Acquiring lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG nova.compute.manager [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] No waiting events found dispatching network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:25:54 user nova-compute[75293]: WARNING nova.compute.manager [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received unexpected event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 for instance with vm_state active and task_state rescuing.
Nov 30 07:25:54 user nova-compute[75293]: DEBUG nova.compute.manager [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] Acquiring lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG nova.compute.manager [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] No waiting events found dispatching network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:25:54 user nova-compute[75293]: WARNING nova.compute.manager [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received unexpected event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 for instance with vm_state active and task_state rescuing.
Nov 30 07:25:54 user nova-compute[75293]: DEBUG nova.compute.manager [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received event network-vif-unplugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] Acquiring lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG nova.compute.manager [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] No waiting events found dispatching network-vif-unplugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:25:54 user nova-compute[75293]: WARNING nova.compute.manager [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received unexpected event network-vif-unplugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 for instance with vm_state active and task_state rescuing.
Nov 30 07:25:54 user nova-compute[75293]: DEBUG nova.compute.manager [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] Acquiring lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG nova.compute.manager [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] No waiting events found dispatching network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:25:54 user nova-compute[75293]: WARNING nova.compute.manager [req-884dbda3-2c0c-4f1d-86c4-23d5fc181692 req-3a6cbe61-f3e1-4597-abb7-09c5080c8267 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received unexpected event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 for instance with vm_state active and task_state rescuing.
Nov 30 07:25:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Starting finish_migration {{(pid=75293) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Instance directory exists: not creating {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 07:25:54 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Creating image(s)
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c34ba0c1050eacf7446cacd7e277652c4ed8cc2.part --force-share --output=json" returned: 0 in 0.234s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG nova.virt.images [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] 0e7d74df-95a1-491d-8f13-8ff252fb14fa was qcow2, converting to raw {{(pid=75293) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG nova.privsep.utils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75293) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4c34ba0c1050eacf7446cacd7e277652c4ed8cc2.part /opt/stack/data/nova/instances/_base/4c34ba0c1050eacf7446cacd7e277652c4ed8cc2.converted {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.177s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk. size=21474836480 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:25:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk 21474836480 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk 21474836480" returned: 0 in 0.156s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4c34ba0c1050eacf7446cacd7e277652c4ed8cc2.part /opt/stack/data/nova/instances/_base/4c34ba0c1050eacf7446cacd7e277652c4ed8cc2.converted" returned: 0 in 0.484s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c34ba0c1050eacf7446cacd7e277652c4ed8cc2.converted --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Did not create local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Ensure instance console log exists: /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Start _get_guest_xml network_info=[{"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-235837065-network", "vif_mac": "fa:16:3e:8c:ff:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvteRwNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd89452ef-96ab-4081-bc40-0f64968de367', 'attached_at': '2023-11-30T07:25:54.000000', 'detached_at': '', 'volume_id': '9e982db5-ba1e-4b95-a127-1b44b7d7c6cf', 'serial': '9e982db5-ba1e-4b95-a127-1b44b7d7c6cf'}, 'delete_on_termination': False, 'attachment_id': 'cb356df3-ed94-48d2-b005-2f798a9b4ab6', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:25:55 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:25:55 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvteRwNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:25:55 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:25:55 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:25:55 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260" returned: 21 in 0.040s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[07633fca-5f19-4218-906f-072562c193e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:25:55 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccf8484-97ae-4ab2-960f-7c1f407bfe5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf] added
Nov 30 07:25:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c34ba0c1050eacf7446cacd7e277652c4ed8cc2.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "4c34ba0c1050eacf7446cacd7e277652c4ed8cc2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.093s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "4c34ba0c1050eacf7446cacd7e277652c4ed8cc2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "4c34ba0c1050eacf7446cacd7e277652c4ed8cc2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c34ba0c1050eacf7446cacd7e277652c4ed8cc2 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[06929b67-c2da-4efb-961e-45490e695923]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a446210c-9e95-4a5d-9368-0f2c3d9f5366]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dvteRwNq {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dvteRwNq" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e50c418-7681-49e3-b89a-e50debab9ac9]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dvteRwNq'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb064b83-c979-4982-8dba-98cb1b7cc9d9]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[54882290-005c-4891-bbd5-20d64a19a145]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:25:55 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:25:55 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:25:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:25:55 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:25:55 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:25:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c34ba0c1050eacf7446cacd7e277652c4ed8cc2 --force-share --output=json" returned: 0 in 0.191s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4c34ba0c1050eacf7446cacd7e277652c4ed8cc2,backing_fmt=raw /opt/stack/data/nova/instances/e67ad73a-2c4b-4cfe-acc5-e62d95d09318/disk.rescue {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57610d3-9b28-47c8-95d1-1a1d46aca19e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260]
Nov 30 07:25:55 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260] successful.
Nov 30 07:25:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4c34ba0c1050eacf7446cacd7e277652c4ed8cc2,backing_fmt=raw /opt/stack/data/nova/instances/e67ad73a-2c4b-4cfe-acc5-e62d95d09318/disk.rescue" returned: 0 in 0.060s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "4c34ba0c1050eacf7446cacd7e277652c4ed8cc2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.objects.instance [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'migration_context' on Instance uuid e67ad73a-2c4b-4cfe-acc5-e62d95d09318 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd1ffda-4412-4b98-bc1e-39972bb893f9]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.objects.base [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Object Instance<e67ad73a-2c4b-4cfe-acc5-e62d95d09318> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Start _get_guest_xml network_info=[{"id": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "address": "fa:16:3e:80:e5:cd", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "vif_mac": "fa:16:3e:80:e5:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce63f6a4-44", "ovs_interfaceid": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0e7d74df-95a1-491d-8f13-8ff252fb14fa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoZTybOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e67ad73a-2c4b-4cfe-acc5-e62d95d09318', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2be752a-991a-4d8e-95a4-0e8570f54cea', 'serial': 'c2be752a-991a-4d8e-95a4-0e8570f54cea'}, 'delete_on_termination': False, 'attachment_id': 'd4c1304c-7748-4810-84dc-147d1bb00c8e', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.objects.instance [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'resources' on Instance uuid e67ad73a-2c4b-4cfe-acc5-e62d95d09318 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.objects.base [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Object Instance<e67ad73a-2c4b-4cfe-acc5-e62d95d09318> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.objects.instance [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'numa_topology' on Instance uuid e67ad73a-2c4b-4cfe-acc5-e62d95d09318 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1be740-d4c5-4553-a5e0-33232d38dc8f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:25:55 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:25:55 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:25:55 user nova-compute[75293]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:25:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:25:55 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:25:55 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:25:55 user nova-compute[75293]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:25:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.objects.base [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Object Instance<e67ad73a-2c4b-4cfe-acc5-e62d95d09318> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:55 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:25:55 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.objects.instance [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'vcpu_model' on Instance uuid e67ad73a-2c4b-4cfe-acc5-e62d95d09318 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34e85ed-8466-4e75-bd83-22f4f7c19aee]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvteRwNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.objects.base [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Object Instance<e67ad73a-2c4b-4cfe-acc5-e62d95d09318> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoZTybOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:25:55 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:25:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '23831383437346332', 'path': '/dev/sdc'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831383437346332', 'path': '/dev/sdc'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.958s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:25:56 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:25:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:25:56 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:25:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4169699e-dfc2-47d5-b16e-a72d9fcebf87]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = AoZTybOa\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 30 07:25:56 user nova-compute[75293]: node.name = iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea
Nov 30 07:25:56 user nova-compute[75293]: node.tpgt = -1
Nov 30 07:25:56 user nova-compute[75293]: node.startup = automatic
Nov 30 07:25:56 user nova-compute[75293]: node.leading_login = No
Nov 30 07:25:56 user nova-compute[75293]: iface.iscsi_ifacename = default
Nov 30 07:25:56 user nova-compute[75293]: iface.net_ifacename = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.ipaddress = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.prefix_len = 0
Nov 30 07:25:56 user nova-compute[75293]: iface.hwaddress = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.transport_name = tcp
Nov 30 07:25:56 user nova-compute[75293]: iface.initiatorname = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.state = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.vlan_id = 0
Nov 30 07:25:56 user nova-compute[75293]: iface.vlan_priority = 0
Nov 30 07:25:56 user nova-compute[75293]: iface.vlan_state = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.iface_num = 0
Nov 30 07:25:56 user nova-compute[75293]: iface.mtu = 0
Nov 30 07:25:56 user nova-compute[75293]: iface.port = 0
Nov 30 07:25:56 user nova-compute[75293]: iface.bootproto = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.subnet_mask = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.gateway = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.dhcp_alt_client_id_state = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.dhcp_alt_client_id = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.dhcp_dns = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.dhcp_learn_iqn = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.dhcp_req_vendor_id_state = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.dhcp_vendor_id_state = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.dhcp_vendor_id = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.dhcp_slp_da = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.fragmentation = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.gratuitous_arp = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.incoming_forwarding = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.tos_state = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.tos = 0
Nov 30 07:25:56 user nova-compute[75293]: iface.ttl = 0
Nov 30 07:25:56 user nova-compute[75293]: iface.delayed_ack = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.tcp_nagle = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.tcp_wsf_state = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.tcp_wsf = 0
Nov 30 07:25:56 user nova-compute[75293]: iface.tcp_timer_scale = 0
Nov 30 07:25:56 user nova-compute[75293]: iface.tcp_timestamp = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.redirect = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.def_task_mgmt_timeout = 0
Nov 30 07:25:56 user nova-compute[75293]: iface.header_digest = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.data_digest = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.immediate_data = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.initial_r2t = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.data_seq_inorder = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.data_pdu_inorder = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.erl = 0
Nov 30 07:25:56 user nova-compute[75293]: iface.max_receive_data_len = 0
Nov 30 07:25:56 user nova-compute[75293]: iface.first_burst_len = 0
Nov 30 07:25:56 user nova-compute[75293]: iface.max_outstanding_r2t = 0
Nov 30 07:25:56 user nova-compute[75293]: iface.max_burst_len = 0
Nov 30 07:25:56 user nova-compute[75293]: iface.chap_auth = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.bidi_chap = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.strict_login_compliance = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.discovery_auth = <empty>
Nov 30 07:25:56 user nova-compute[75293]: iface.discovery_logout = <empty>
Nov 30 07:25:56 user nova-compute[75293]: node.discovery_address = <empty>
Nov 30 07:25:56 user nova-compute[75293]: node.discovery_port = 0
Nov 30 07:25:56 user nova-compute[75293]: node.discovery_type = static
Nov 30 07:25:56 user nova-compute[75293]: node.session.initial_cmdsn = 0
Nov 30 07:25:56 user nova-compute[75293]: node.session.initial_login_retry_max = 8
Nov 30 07:25:56 user nova-compute[75293]: node.session.xmit_thread_priority = -20
Nov 30 07:25:56 user nova-compute[75293]: node.session.cmds_max = 128
Nov 30 07:25:56 user nova-compute[75293]: node.session.queue_depth = 32
Nov 30 07:25:56 user nova-compute[75293]: node.session.nr_sessions = 1
Nov 30 07:25:56 user nova-compute[75293]: node.session.auth.authmethod = CHAP
Nov 30 07:25:56 user nova-compute[75293]: node.session.auth.username = AoZTybOa
Nov 30 07:25:56 user nova-compute[75293]: node.session.auth.password = ***
Nov 30 07:25:56 user nova-compute[75293]: node.session.auth.username_in = <empty>
Nov 30 07:25:56 user nova-compute[75293]: node.session.auth.password_in = <empty>
Nov 30 07:25:56 user nova-compute[75293]: node.session.auth.chap_algs = MD5
Nov 30 07:25:56 user nova-compute[75293]: node.session.timeo.replacement_timeout = 120
Nov 30 07:25:56 user nova-compute[75293]: node.session.err_timeo.abort_timeout = 15
Nov 30 07:25:56 user nova-compute[75293]: node.session.err_timeo.lu_reset_timeout = 30
Nov 30 07:25:56 user nova-compute[75293]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 30 07:25:56 user nova-compute[75293]: node.session.err_timeo.host_reset_timeout = 60
Nov 30 07:25:56 user nova-compute[75293]: node.session.iscsi.FastAbort = Yes
Nov 30 07:25:56 user nova-compute[75293]: node.session.iscsi.InitialR2T = No
Nov 30 07:25:56 user nova-compute[75293]: node.session.iscsi.ImmediateData = Yes
Nov 30 07:25:56 user nova-compute[75293]: node.session.iscsi.FirstBurstLength = 262144
Nov 30 07:25:56 user nova-compute[75293]: node.session.iscsi.MaxBurstLength = 16776192
Nov 30 07:25:56 user nova-compute[75293]: node.session.iscsi.DefaultTime2Retain = 0
Nov 30 07:25:56 user nova-compute[75293]: node.session.iscsi.DefaultTime2Wait = 2
Nov 30 07:25:56 user nova-compute[75293]: node.session.iscsi.MaxConnections = 1
Nov 30 07:25:56 user nova-compute[75293]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 30 07:25:56 user nova-compute[75293]: node.session.iscsi.ERL = 0
Nov 30 07:25:56 user nova-compute[75293]: node.session.scan = manual
Nov 30 07:25:56 user nova-compute[75293]: node.session.reopen_max = 0
Nov 30 07:25:56 user nova-compute[75293]: node.conn[0].address = 172.16.0.220
Nov 30 07:25:56 user nova-compute[75293]: node.conn[0].port = 3260
Nov 30 07:25:56 user nova-compute[75293]: node.conn[0].startup = manual
Nov 30 07:25:56 user nova-compute[75293]: node.conn[0].tcp.window_size = 524288
Nov 30 07:25:56 user nova-compute[75293]: node.conn[0].tcp.type_of_service = 0
Nov 30 07:25:56 user nova-compute[75293]: node.conn[0].timeo.logout_timeout = 15
Nov 30 07:25:56 user nova-compute[75293]: node.conn[0].timeo.login_timeout = 15
Nov 30 07:25:56 user nova-compute[75293]: node.conn[0].timeo.auth_timeout = 45
Nov 30 07:25:56 user nova-compute[75293]: node.conn[0].timeo.noop_out_interval = 5
Nov 30 07:25:56 user nova-compute[75293]: node.conn[0].timeo.noop_out_timeout = 5
Nov 30 07:25:56 user nova-compute[75293]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 30 07:25:56 user nova-compute[75293]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 30 07:25:56 user nova-compute[75293]: node.conn[0].iscsi.HeaderDigest = None
Nov 30 07:25:56 user nova-compute[75293]: node.conn[0].iscsi.DataDigest = None
Nov 30 07:25:56 user nova-compute[75293]: node.conn[0].iscsi.IFMarker = No
Nov 30 07:25:56 user nova-compute[75293]: node.conn[0].iscsi.OFMarker = No
Nov 30 07:25:56 user nova-compute[75293]: # END RECORD
Nov 30 07:25:56 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1953113672',display_name='tempest-ServerActionsTestOtherB-server-1953113672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1953113672',id=35,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnRjCaWy780if2CkUOoZrcrdcD+P1g/YJnFZ7z8Y8pV7AT42ymHjcVO5HJTfrEuy5cWDNDXLYAnT+pwSMKRHRG0FXx2bJrOk/qq7N46wXruznAxyX6mXSnteMjD8Ewz6w==',key_name='tempest-keypair-319510887',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:21:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2e631f0d47cc43a1b670e1b78b482e67',ramdisk_id='',reservation_id='r-mjklwfn9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-70269142',owner_user_name='tempest-ServerActionsTestOtherB-70269142-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fb08d8e90be4f6eb2efd21f2cbf2dcd',uuid=d89452ef-96ab-4081-bc40-0f64968de367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-235837065-network", "vif_mac": "fa:16:3e:8c:ff:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Converting VIF {"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-235837065-network", "vif_mac": "fa:16:3e:8c:ff:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:25:56 user nova-compute[75293]:   <uuid>d89452ef-96ab-4081-bc40-0f64968de367</uuid>
Nov 30 07:25:56 user nova-compute[75293]:   <name>instance-00000023</name>
Nov 30 07:25:56 user nova-compute[75293]:   <memory>2097152</memory>
Nov 30 07:25:56 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:25:56 user nova-compute[75293]:   <metadata>
Nov 30 07:25:56 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:25:56 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:25:56 user nova-compute[75293]:       <nova:name>tempest-ServerActionsTestOtherB-server-1953113672</nova:name>
Nov 30 07:25:56 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:25:55</nova:creationTime>
Nov 30 07:25:56 user nova-compute[75293]:       <nova:flavor name="m1.small">
Nov 30 07:25:56 user nova-compute[75293]:         <nova:memory>2048</nova:memory>
Nov 30 07:25:56 user nova-compute[75293]:         <nova:disk>20</nova:disk>
Nov 30 07:25:56 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:25:56 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:25:56 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:25:56 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:25:56 user nova-compute[75293]:       <nova:owner>
Nov 30 07:25:56 user nova-compute[75293]:         <nova:user uuid="6fb08d8e90be4f6eb2efd21f2cbf2dcd">tempest-ServerActionsTestOtherB-70269142-project-member</nova:user>
Nov 30 07:25:56 user nova-compute[75293]:         <nova:project uuid="2e631f0d47cc43a1b670e1b78b482e67">tempest-ServerActionsTestOtherB-70269142</nova:project>
Nov 30 07:25:56 user nova-compute[75293]:       </nova:owner>
Nov 30 07:25:56 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:25:56 user nova-compute[75293]:       <nova:ports>
Nov 30 07:25:56 user nova-compute[75293]:         <nova:port uuid="0b9bbab7-780f-4b09-9c9b-4448e8ff2323">
Nov 30 07:25:56 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 07:25:56 user nova-compute[75293]:         </nova:port>
Nov 30 07:25:56 user nova-compute[75293]:       </nova:ports>
Nov 30 07:25:56 user nova-compute[75293]:     </nova:instance>
Nov 30 07:25:56 user nova-compute[75293]:   </metadata>
Nov 30 07:25:56 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:25:56 user nova-compute[75293]:     <system>
Nov 30 07:25:56 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:25:56 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:25:56 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:25:56 user nova-compute[75293]:       <entry name="serial">d89452ef-96ab-4081-bc40-0f64968de367</entry>
Nov 30 07:25:56 user nova-compute[75293]:       <entry name="uuid">d89452ef-96ab-4081-bc40-0f64968de367</entry>
Nov 30 07:25:56 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:25:56 user nova-compute[75293]:     </system>
Nov 30 07:25:56 user nova-compute[75293]:   </sysinfo>
Nov 30 07:25:56 user nova-compute[75293]:   <os>
Nov 30 07:25:56 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:25:56 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:25:56 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:25:56 user nova-compute[75293]:   </os>
Nov 30 07:25:56 user nova-compute[75293]:   <features>
Nov 30 07:25:56 user nova-compute[75293]:     <acpi/>
Nov 30 07:25:56 user nova-compute[75293]:     <apic/>
Nov 30 07:25:56 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:25:56 user nova-compute[75293]:   </features>
Nov 30 07:25:56 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:25:56 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:25:56 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:25:56 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:25:56 user nova-compute[75293]:   </clock>
Nov 30 07:25:56 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:25:56 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:25:56 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:25:56 user nova-compute[75293]:   </cpu>
Nov 30 07:25:56 user nova-compute[75293]:   <devices>
Nov 30 07:25:56 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:25:56 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:25:56 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk"/>
Nov 30 07:25:56 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:25:56 user nova-compute[75293]:     </disk>
Nov 30 07:25:56 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:25:56 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:25:56 user nova-compute[75293]:       <source dev="/dev/sdc"/>
Nov 30 07:25:56 user nova-compute[75293]:       <target dev="vdb" bus="virtio"/>
Nov 30 07:25:56 user nova-compute[75293]:       <serial>9e982db5-ba1e-4b95-a127-1b44b7d7c6cf</serial>
Nov 30 07:25:56 user nova-compute[75293]:     </disk>
Nov 30 07:25:56 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:25:56 user nova-compute[75293]:       <mac address="fa:16:3e:8c:ff:ac"/>
Nov 30 07:25:56 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:25:56 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:25:56 user nova-compute[75293]:       <target dev="tap0b9bbab7-78"/>
Nov 30 07:25:56 user nova-compute[75293]:     </interface>
Nov 30 07:25:56 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:25:56 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/console.log" append="off"/>
Nov 30 07:25:56 user nova-compute[75293]:     </serial>
Nov 30 07:25:56 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:25:56 user nova-compute[75293]:     <video>
Nov 30 07:25:56 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:25:56 user nova-compute[75293]:     </video>
Nov 30 07:25:56 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:25:56 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:25:56 user nova-compute[75293]:     </rng>
Nov 30 07:25:56 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:25:56 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:25:56 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:25:56 user nova-compute[75293]:     </memballoon>
Nov 30 07:25:56 user nova-compute[75293]:   </devices>
Nov 30 07:25:56 user nova-compute[75293]: </domain>
Nov 30 07:25:56 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1953113672',display_name='tempest-ServerActionsTestOtherB-server-1953113672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1953113672',id=35,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnRjCaWy780if2CkUOoZrcrdcD+P1g/YJnFZ7z8Y8pV7AT42ymHjcVO5HJTfrEuy5cWDNDXLYAnT+pwSMKRHRG0FXx2bJrOk/qq7N46wXruznAxyX6mXSnteMjD8Ewz6w==',key_name='tempest-keypair-319510887',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:21:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2e631f0d47cc43a1b670e1b78b482e67',ramdisk_id='',reservation_id='r-mjklwfn9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-70269142',owner_user_name='tempest-ServerActionsTestOtherB-70269142-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fb08d8e90be4f6eb2efd21f2cbf2dcd',uuid=d89452ef-96ab-4081-bc40-0f64968de367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-235837065-network", "vif_mac": "fa:16:3e:8c:ff:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Converting VIF {"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-235837065-network", "vif_mac": "fa:16:3e:8c:ff:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG os_vif [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7250f6d9-b0d5-5c3e-b2da-7787ad110cdc', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1da74f6-61c4-4730-a8b3-eb2bad3e4f21]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b9bbab7-78, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b9bbab7-78, col_values=(('qos', UUID('7bf9da6c-8caf-41af-b819-f0a5042f36a2')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b9bbab7-78, col_values=(('external_ids', {'iface-id': '0b9bbab7-780f-4b09-9c9b-4448e8ff2323', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:ff:ac', 'vm-uuid': 'd89452ef-96ab-4081-bc40-0f64968de367'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[553e5ea9-af4d-4653-8679-94b12794ea9c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoZTybOa {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:57 user nova-compute[75293]: INFO os_vif [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78')
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoZTybOa" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b2d2c7-78a8-43f7-aac3-b102ec076bf9]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AoZTybOa'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ebe065-f136-457e-98bd-251398830c76]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] No VIF found with MAC fa:16:3e:8c:ff:ac, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada1d00f-9404-4f5b-b47d-3216220cd63e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:25:57 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:25:57 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:25:57 user nova-compute[75293]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:25:57 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:25:57 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:25:57 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:25:57 user nova-compute[75293]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:25:57 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.188s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] HCTL ('33', '0', '0', 0) found on session 43 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.compute.manager [req-483d7579-7d98-4d23-8171-876ddabbebc1 req-befce33e-1e2c-49c5-bb7c-cc0bbdbc9bb6 service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Received event network-changed-0160f878-44ac-4d72-937c-4479bb41226d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.compute.manager [req-483d7579-7d98-4d23-8171-876ddabbebc1 req-befce33e-1e2c-49c5-bb7c-cc0bbdbc9bb6 service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Refreshing instance network info cache due to event network-changed-0160f878-44ac-4d72-937c-4479bb41226d. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-483d7579-7d98-4d23-8171-876ddabbebc1 req-befce33e-1e2c-49c5-bb7c-cc0bbdbc9bb6 service nova] Acquiring lock "refresh_cache-47068cdd-7fbb-4612-892e-bfdccdac9cbd" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-483d7579-7d98-4d23-8171-876ddabbebc1 req-befce33e-1e2c-49c5-bb7c-cc0bbdbc9bb6 service nova] Acquired lock "refresh_cache-47068cdd-7fbb-4612-892e-bfdccdac9cbd" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.network.neutron [req-483d7579-7d98-4d23-8171-876ddabbebc1 req-befce33e-1e2c-49c5-bb7c-cc0bbdbc9bb6 service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Refreshing network info cache for port 0160f878-44ac-4d72-937c-4479bb41226d {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15214e5-6b95-4a79-aa4d-2eb98951d52b]: (4, ('0 0 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Searching for a device in session 43 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoZTybOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.226s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] <== connect_volume: return (1185ms) {'type': 'block', 'scsi_wwn': '26362666535383966', 'path': '/dev/sdb'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362666535383966', 'path': '/dev/sdb'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2032492824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2032492824',id=38,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f09e4044dadb4f2aa0d29f35f23008d2',ramdisk_id='',reservation_id='r-4p00a3zd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:24:27Z,user_data=None,user_id='83119c1bbe4142a086680a113403018c',uuid=e67ad73a-2c4b-4cfe-acc5-e62d95d09318,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "address": "fa:16:3e:80:e5:cd", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "vif_mac": "fa:16:3e:80:e5:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce63f6a4-44", "ovs_interfaceid": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converting VIF {"id": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "address": "fa:16:3e:80:e5:cd", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "vif_mac": "fa:16:3e:80:e5:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce63f6a4-44", "ovs_interfaceid": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:e5:cd,bridge_name='br-int',has_traffic_filtering=True,id=ce63f6a4-4402-477b-9c67-d63143bfa7c9,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce63f6a4-44') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.objects.instance [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'pci_devices' on Instance uuid e67ad73a-2c4b-4cfe-acc5-e62d95d09318 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.objects.base [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Object Instance<e67ad73a-2c4b-4cfe-acc5-e62d95d09318> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:25:57 user nova-compute[75293]:   <uuid>e67ad73a-2c4b-4cfe-acc5-e62d95d09318</uuid>
Nov 30 07:25:57 user nova-compute[75293]:   <name>instance-00000026</name>
Nov 30 07:25:57 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:25:57 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:25:57 user nova-compute[75293]:   <metadata>
Nov 30 07:25:57 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:25:57 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:25:57 user nova-compute[75293]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2032492824</nova:name>
Nov 30 07:25:57 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:25:55</nova:creationTime>
Nov 30 07:25:57 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:25:57 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:25:57 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:25:57 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:25:57 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:25:57 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:25:57 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:25:57 user nova-compute[75293]:       <nova:owner>
Nov 30 07:25:57 user nova-compute[75293]:         <nova:user uuid="83119c1bbe4142a086680a113403018c">tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member</nova:user>
Nov 30 07:25:57 user nova-compute[75293]:         <nova:project uuid="f09e4044dadb4f2aa0d29f35f23008d2">tempest-ServerBootFromVolumeStableRescueTest-2053873633</nova:project>
Nov 30 07:25:57 user nova-compute[75293]:       </nova:owner>
Nov 30 07:25:57 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:25:57 user nova-compute[75293]:       <nova:ports>
Nov 30 07:25:57 user nova-compute[75293]:         <nova:port uuid="ce63f6a4-4402-477b-9c67-d63143bfa7c9">
Nov 30 07:25:57 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 07:25:57 user nova-compute[75293]:         </nova:port>
Nov 30 07:25:57 user nova-compute[75293]:       </nova:ports>
Nov 30 07:25:57 user nova-compute[75293]:     </nova:instance>
Nov 30 07:25:57 user nova-compute[75293]:   </metadata>
Nov 30 07:25:57 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:25:57 user nova-compute[75293]:     <system>
Nov 30 07:25:57 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:25:57 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:25:57 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:25:57 user nova-compute[75293]:       <entry name="serial">e67ad73a-2c4b-4cfe-acc5-e62d95d09318</entry>
Nov 30 07:25:57 user nova-compute[75293]:       <entry name="uuid">e67ad73a-2c4b-4cfe-acc5-e62d95d09318</entry>
Nov 30 07:25:57 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:25:57 user nova-compute[75293]:     </system>
Nov 30 07:25:57 user nova-compute[75293]:   </sysinfo>
Nov 30 07:25:57 user nova-compute[75293]:   <os>
Nov 30 07:25:57 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:25:57 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:25:57 user nova-compute[75293]:   </os>
Nov 30 07:25:57 user nova-compute[75293]:   <features>
Nov 30 07:25:57 user nova-compute[75293]:     <acpi/>
Nov 30 07:25:57 user nova-compute[75293]:     <apic/>
Nov 30 07:25:57 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:25:57 user nova-compute[75293]:   </features>
Nov 30 07:25:57 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:25:57 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:25:57 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:25:57 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:25:57 user nova-compute[75293]:   </clock>
Nov 30 07:25:57 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:25:57 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:25:57 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:25:57 user nova-compute[75293]:   </cpu>
Nov 30 07:25:57 user nova-compute[75293]:   <devices>
Nov 30 07:25:57 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:25:57 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:25:57 user nova-compute[75293]:       <source dev="/dev/sdb"/>
Nov 30 07:25:57 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:25:57 user nova-compute[75293]:       <serial>c2be752a-991a-4d8e-95a4-0e8570f54cea</serial>
Nov 30 07:25:57 user nova-compute[75293]:     </disk>
Nov 30 07:25:57 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:25:57 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:25:57 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/e67ad73a-2c4b-4cfe-acc5-e62d95d09318/disk.rescue"/>
Nov 30 07:25:57 user nova-compute[75293]:       <target dev="vdb" bus="virtio"/>
Nov 30 07:25:57 user nova-compute[75293]:       <boot order="1"/>
Nov 30 07:25:57 user nova-compute[75293]:     </disk>
Nov 30 07:25:57 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:25:57 user nova-compute[75293]:       <mac address="fa:16:3e:80:e5:cd"/>
Nov 30 07:25:57 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:25:57 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:25:57 user nova-compute[75293]:       <target dev="tapce63f6a4-44"/>
Nov 30 07:25:57 user nova-compute[75293]:     </interface>
Nov 30 07:25:57 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:25:57 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/e67ad73a-2c4b-4cfe-acc5-e62d95d09318/console.log" append="off"/>
Nov 30 07:25:57 user nova-compute[75293]:     </serial>
Nov 30 07:25:57 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:25:57 user nova-compute[75293]:     <video>
Nov 30 07:25:57 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:25:57 user nova-compute[75293]:     </video>
Nov 30 07:25:57 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:25:57 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:25:57 user nova-compute[75293]:     </rng>
Nov 30 07:25:57 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:25:57 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:25:57 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:25:57 user nova-compute[75293]:     </memballoon>
Nov 30 07:25:57 user nova-compute[75293]:   </devices>
Nov 30 07:25:57 user nova-compute[75293]: </domain>
Nov 30 07:25:57 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:25:57 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Instance destroyed successfully.
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] No VIF found with MAC fa:16:3e:80:e5:cd, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.objects.instance [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lazy-loading 'flavor' on Instance uuid 47068cdd-7fbb-4612-892e-bfdccdac9cbd {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:25:57 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Ignoring supplied device name: /dev/vdb
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:57 user nova-compute[75293]: INFO nova.compute.manager [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Attaching volume da9a06bf-e065-407c-83b4-f76bee1b9345 to /dev/vdb
Nov 30 07:25:57 user nova-compute[75293]: DEBUG os_brick.utils [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c5be66-5c84-4392-94fa-e2be1446e3cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9a7b91-6d4b-4015-bc5a-3edd180e0927]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e18f7b-a347-4883-8f5a-1505f39ce41b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e51b90-6ebb-4f4a-9562-2b61f812c958]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:25:57 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[59506197-6385-4251-a5e8-1e26d5b25793]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG os_brick.utils [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Updating existing volume attachment record: 19403bdb-c471-41d4-853a-f8568dbfc716 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.network.neutron [req-483d7579-7d98-4d23-8171-876ddabbebc1 req-befce33e-1e2c-49c5-bb7c-cc0bbdbc9bb6 service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Updated VIF entry in instance network info cache for port 0160f878-44ac-4d72-937c-4479bb41226d. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG nova.network.neutron [req-483d7579-7d98-4d23-8171-876ddabbebc1 req-befce33e-1e2c-49c5-bb7c-cc0bbdbc9bb6 service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Updating instance_info_cache with network_info: [{"id": "0160f878-44ac-4d72-937c-4479bb41226d", "address": "fa:16:3e:80:bb:2c", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0160f878-44", "ovs_interfaceid": "0160f878-44ac-4d72-937c-4479bb41226d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:25:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-483d7579-7d98-4d23-8171-876ddabbebc1 req-befce33e-1e2c-49c5-bb7c-cc0bbdbc9bb6 service nova] Releasing lock "refresh_cache-47068cdd-7fbb-4612-892e-bfdccdac9cbd" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:25:58 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-1ec84e2e-934c-49ae-b680-36c882c95e1a req-44967433-292e-4af6-b817-be293dc182dd service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received event network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1ec84e2e-934c-49ae-b680-36c882c95e1a req-44967433-292e-4af6-b817-be293dc182dd service nova] Acquiring lock "d89452ef-96ab-4081-bc40-0f64968de367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1ec84e2e-934c-49ae-b680-36c882c95e1a req-44967433-292e-4af6-b817-be293dc182dd service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1ec84e2e-934c-49ae-b680-36c882c95e1a req-44967433-292e-4af6-b817-be293dc182dd service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-1ec84e2e-934c-49ae-b680-36c882c95e1a req-44967433-292e-4af6-b817-be293dc182dd service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] No waiting events found dispatching network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:25:59 user nova-compute[75293]: WARNING nova.compute.manager [req-1ec84e2e-934c-49ae-b680-36c882c95e1a req-44967433-292e-4af6-b817-be293dc182dd service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received unexpected event network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 for instance with vm_state active and task_state resize_finish.
Nov 30 07:25:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-4d05e1ae-f0d3-44c4-8012-37cd7a57495a req-8789037b-60cc-4d92-8d18-55c3e5692bae service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4d05e1ae-f0d3-44c4-8012-37cd7a57495a req-8789037b-60cc-4d92-8d18-55c3e5692bae service nova] Acquiring lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4d05e1ae-f0d3-44c4-8012-37cd7a57495a req-8789037b-60cc-4d92-8d18-55c3e5692bae service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4d05e1ae-f0d3-44c4-8012-37cd7a57495a req-8789037b-60cc-4d92-8d18-55c3e5692bae service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-4d05e1ae-f0d3-44c4-8012-37cd7a57495a req-8789037b-60cc-4d92-8d18-55c3e5692bae service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] No waiting events found dispatching network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:25:59 user nova-compute[75293]: WARNING nova.compute.manager [req-4d05e1ae-f0d3-44c4-8012-37cd7a57495a req-8789037b-60cc-4d92-8d18-55c3e5692bae service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received unexpected event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 for instance with vm_state active and task_state rescuing.
Nov 30 07:25:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:25:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:01 user nova-compute[75293]: DEBUG nova.compute.manager [req-b527a8cf-18a2-46dc-943f-a63e97342f34 req-de0c6a97-a640-4de0-bc1a-ffddff48a4cc service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received event network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:26:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b527a8cf-18a2-46dc-943f-a63e97342f34 req-de0c6a97-a640-4de0-bc1a-ffddff48a4cc service nova] Acquiring lock "d89452ef-96ab-4081-bc40-0f64968de367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:26:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b527a8cf-18a2-46dc-943f-a63e97342f34 req-de0c6a97-a640-4de0-bc1a-ffddff48a4cc service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:26:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b527a8cf-18a2-46dc-943f-a63e97342f34 req-de0c6a97-a640-4de0-bc1a-ffddff48a4cc service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:26:01 user nova-compute[75293]: DEBUG nova.compute.manager [req-b527a8cf-18a2-46dc-943f-a63e97342f34 req-de0c6a97-a640-4de0-bc1a-ffddff48a4cc service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] No waiting events found dispatching network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:26:01 user nova-compute[75293]: WARNING nova.compute.manager [req-b527a8cf-18a2-46dc-943f-a63e97342f34 req-de0c6a97-a640-4de0-bc1a-ffddff48a4cc service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received unexpected event network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 for instance with vm_state active and task_state resize_finish.
Nov 30 07:26:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:02 user nova-compute[75293]: DEBUG nova.compute.manager [req-57461574-e37a-48ff-b410-4721a31d0ce9 req-3eb43444-1311-45be-9310-bc9b5d5aee35 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:26:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-57461574-e37a-48ff-b410-4721a31d0ce9 req-3eb43444-1311-45be-9310-bc9b5d5aee35 service nova] Acquiring lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:26:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-57461574-e37a-48ff-b410-4721a31d0ce9 req-3eb43444-1311-45be-9310-bc9b5d5aee35 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:26:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-57461574-e37a-48ff-b410-4721a31d0ce9 req-3eb43444-1311-45be-9310-bc9b5d5aee35 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:26:02 user nova-compute[75293]: DEBUG nova.compute.manager [req-57461574-e37a-48ff-b410-4721a31d0ce9 req-3eb43444-1311-45be-9310-bc9b5d5aee35 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] No waiting events found dispatching network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:26:02 user nova-compute[75293]: WARNING nova.compute.manager [req-57461574-e37a-48ff-b410-4721a31d0ce9 req-3eb43444-1311-45be-9310-bc9b5d5aee35 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received unexpected event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 for instance with vm_state active and task_state rescuing.
Nov 30 07:26:02 user nova-compute[75293]: DEBUG nova.compute.manager [None req-934f442f-1d58-4dd7-a5ab-0a7356a207bd tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:26:02 user nova-compute[75293]: DEBUG nova.compute.manager [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:26:02 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Instance running successfully.
Nov 30 07:26:02 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Failed to set time: agent not configured {{(pid=75293) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 30 07:26:02 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-588d3cc8-a31f-4d87-87a1-523d15a6a0bf tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] finish_migration finished successfully. {{(pid=75293) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 30 07:26:02 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:26:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:26:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67ad73a-2c4b-4cfe-acc5-e62d95d09318/disk.rescue --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67ad73a-2c4b-4cfe-acc5-e62d95d09318/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67ad73a-2c4b-4cfe-acc5-e62d95d09318/disk.rescue --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67ad73a-2c4b-4cfe-acc5-e62d95d09318/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:26:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:26:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:26:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:26:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:26:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:26:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:26:05 user nova-compute[75293]: INFO nova.compute.manager [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Terminating instance
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:26:06 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:26:06 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=8049MB free_disk=24.84154510498047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Applying migration context for instance d89452ef-96ab-4081-bc40-0f64968de367 as it has an incoming, in-progress migration 6830e03e-45db-4f4e-a180-42a1c39448d1. Migration status is finished {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 30 07:26:06 user nova-compute[75293]: INFO nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Updating resource usage from migration 6830e03e-45db-4f4e-a180-42a1c39448d1
Nov 30 07:26:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance c8d1df78-2aa2-4710-a570-5f72c60cfc26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 4ebf0be9-15e0-418c-a554-7885c79a725b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 54c60b45-04dc-4d3b-96ec-c2d0f583cafa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance e67ad73a-2c4b-4cfe-acc5-e62d95d09318 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 47068cdd-7fbb-4612-892e-bfdccdac9cbd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 11e67339-be9e-481a-a8d2-8573caa97866 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Migration 6830e03e-45db-4f4e-a180-42a1c39448d1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance d89452ef-96ab-4081-bc40-0f64968de367 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 2e215797-58b6-47bb-acbc-edd77e6cca2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-985d0b6a-226c-4382-92fe-d882ef1f61be req-b0aeed6d-b355-4e93-a155-a3e1daf981c3 service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Received event network-vif-unplugged-ea487809-e5c3-435b-be3e-f59400b4d9cd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-985d0b6a-226c-4382-92fe-d882ef1f61be req-b0aeed6d-b355-4e93-a155-a3e1daf981c3 service nova] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-985d0b6a-226c-4382-92fe-d882ef1f61be req-b0aeed6d-b355-4e93-a155-a3e1daf981c3 service nova] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-985d0b6a-226c-4382-92fe-d882ef1f61be req-b0aeed6d-b355-4e93-a155-a3e1daf981c3 service nova] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-985d0b6a-226c-4382-92fe-d882ef1f61be req-b0aeed6d-b355-4e93-a155-a3e1daf981c3 service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] No waiting events found dispatching network-vif-unplugged-ea487809-e5c3-435b-be3e-f59400b4d9cd {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-985d0b6a-226c-4382-92fe-d882ef1f61be req-b0aeed6d-b355-4e93-a155-a3e1daf981c3 service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Received event network-vif-unplugged-ea487809-e5c3-435b-be3e-f59400b4d9cd for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.695s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:06 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Instance destroyed successfully.
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.objects.instance [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lazy-loading 'resources' on Instance uuid 4ebf0be9-15e0-418c-a554-7885c79a725b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmxAvaBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:26:06 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:26:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:26:06 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:26:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:26:06 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1604218845',display_name='tempest-SnapshotDataIntegrityTests-server-1604218845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1604218845',id=32,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzYsxZ418k2vj1YYw6cdBYwMBQ4dcEd5pIhCIZp6CbUzAItFtfho7tBwYOSXNU/KeqidVSjxlNTuuaLnfDZOLOPRS986mNk82h+lfxvXWq+0zijBaykK6Y6fhpT7KooDg==',key_name='tempest-keypair-775752113',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:19:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9623b2e7295481597a1c6e925ed5d06',ramdisk_id='',reservation_id='r-s2i3etsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-263033880',owner_user_name='tempest-SnapshotDataIntegrityTests-263033880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:19:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413f65d184084af4be1418367fd3b9da',uuid=4ebf0be9-15e0-418c-a554-7885c79a725b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "address": "fa:16:3e:61:ea:d9", "network": {"id": "f5788c0d-7b19-4bf5-8197-f7a852630bd6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1462636557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9623b2e7295481597a1c6e925ed5d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea487809-e5", "ovs_interfaceid": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Converting VIF {"id": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "address": "fa:16:3e:61:ea:d9", "network": {"id": "f5788c0d-7b19-4bf5-8197-f7a852630bd6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1462636557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9623b2e7295481597a1c6e925ed5d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea487809-e5", "ovs_interfaceid": "ea487809-e5c3-435b-be3e-f59400b4d9cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:ea:d9,bridge_name='br-int',has_traffic_filtering=True,id=ea487809-e5c3-435b-be3e-f59400b4d9cd,network=Network(f5788c0d-7b19-4bf5-8197-f7a852630bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea487809-e5') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG os_vif [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:ea:d9,bridge_name='br-int',has_traffic_filtering=True,id=ea487809-e5c3-435b-be3e-f59400b4d9cd,network=Network(f5788c0d-7b19-4bf5-8197-f7a852630bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea487809-e5') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea487809-e5, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3c416ae-33fc-43d7-adb3-82ec7fbd950a) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6f4593-15ec-4d29-a421-18ae2b38dbc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:26:06 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:26:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:06 user nova-compute[75293]: INFO os_vif [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:ea:d9,bridge_name='br-int',has_traffic_filtering=True,id=ea487809-e5c3-435b-be3e-f59400b4d9cd,network=Network(f5788c0d-7b19-4bf5-8197-f7a852630bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea487809-e5')
Nov 30 07:26:06 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Deleting instance files /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b_del
Nov 30 07:26:06 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Deletion of /opt/stack/data/nova/instances/4ebf0be9-15e0-418c-a554-7885c79a725b_del complete
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0f15d3-d0f5-4a8e-b5a9-9fe63d44ad61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345] added
Nov 30 07:26:07 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b343e34-edee-4169-9ade-76d1b70f251f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acbf90d-710f-48ac-b0b9-2ff7f341f31c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmxAvaBI {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmxAvaBI" returned: 0 in 0.035s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c027ed-c9a2-4efa-8011-a3951cbe6a6a]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zmxAvaBI'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:26:07 user nova-compute[75293]: INFO nova.compute.manager [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6768f2d9-8cf5-4f53-9e41-27964424d6b4]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[820e7abb-7fb0-45a7-af9a-48ab208e9052]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:26:07 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:26:07 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:26:07 user nova-compute[75293]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:26:07 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:26:07 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:26:07 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:26:07 user nova-compute[75293]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:26:07 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[956450a1-b480-49fc-b9ce-e508a49d60fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345, portal: 172.16.0.220,3260]
Nov 30 07:26:07 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345, portal: 172.16.0.220,3260] successful.
Nov 30 07:26:07 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[36499411-c499-4914-9da3-ab618787f633]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ce10b9-afba-4507-8248-9be6637c9bd9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:26:07 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:26:07 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:26:07 user nova-compute[75293]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:26:07 user nova-compute[75293]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 (non-flash)
Nov 30 07:26:07 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:26:07 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:26:07 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:26:07 user nova-compute[75293]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:26:07 user nova-compute[75293]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 (non-flash)
Nov 30 07:26:07 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] HCTL ('37', '-', '-', 0) found on session 48 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.049s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b88942-6264-4e0a-aa05-16a7c007ffd7]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Searching for a device in session 48 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmxAvaBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:08 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:26:08 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Took 0.93 seconds to deallocate network for instance.
Nov 30 07:26:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:26:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:26:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:26:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '26361383963383734', 'path': '/dev/sdf'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:26:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361383963383734', 'path': '/dev/sdf'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:26:08 user nova-compute[75293]: DEBUG nova.objects.instance [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lazy-loading 'flavor' on Instance uuid 47068cdd-7fbb-4612-892e-bfdccdac9cbd {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:26:08 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:26:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:26:08 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:26:08 user nova-compute[75293]:   <source dev="/dev/sdf"/>
Nov 30 07:26:08 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:26:08 user nova-compute[75293]:   <serial>da9a06bf-e065-407c-83b4-f76bee1b9345</serial>
Nov 30 07:26:08 user nova-compute[75293]: </disk>
Nov 30 07:26:08 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:26:08 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:26:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:26:08 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Deleted allocations for instance 4ebf0be9-15e0-418c-a554-7885c79a725b
Nov 30 07:26:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-7b45ae54-a158-4c6e-8989-723de6a9f4f8 req-63a6b4de-c48b-47ba-8d7e-1ae2dd7d11dd service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Received event network-vif-plugged-ea487809-e5c3-435b-be3e-f59400b4d9cd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:26:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7b45ae54-a158-4c6e-8989-723de6a9f4f8 req-63a6b4de-c48b-47ba-8d7e-1ae2dd7d11dd service nova] Acquiring lock "4ebf0be9-15e0-418c-a554-7885c79a725b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:26:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7b45ae54-a158-4c6e-8989-723de6a9f4f8 req-63a6b4de-c48b-47ba-8d7e-1ae2dd7d11dd service nova] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:26:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7b45ae54-a158-4c6e-8989-723de6a9f4f8 req-63a6b4de-c48b-47ba-8d7e-1ae2dd7d11dd service nova] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:26:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-7b45ae54-a158-4c6e-8989-723de6a9f4f8 req-63a6b4de-c48b-47ba-8d7e-1ae2dd7d11dd service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] No waiting events found dispatching network-vif-plugged-ea487809-e5c3-435b-be3e-f59400b4d9cd {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:26:08 user nova-compute[75293]: WARNING nova.compute.manager [req-7b45ae54-a158-4c6e-8989-723de6a9f4f8 req-63a6b4de-c48b-47ba-8d7e-1ae2dd7d11dd service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Received unexpected event network-vif-plugged-ea487809-e5c3-435b-be3e-f59400b4d9cd for instance with vm_state deleted and task_state None.
Nov 30 07:26:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-7b45ae54-a158-4c6e-8989-723de6a9f4f8 req-63a6b4de-c48b-47ba-8d7e-1ae2dd7d11dd service nova] [instance: 4ebf0be9-15e0-418c-a554-7885c79a725b] Received event network-vif-deleted-ea487809-e5c3-435b-be3e-f59400b4d9cd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:26:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6480719a-1cb2-437d-b133-25819f2e0430 tempest-SnapshotDataIntegrityTests-263033880 tempest-SnapshotDataIntegrityTests-263033880-project-member] Lock "4ebf0be9-15e0-418c-a554-7885c79a725b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.041s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:26:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:26:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:26:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] No VIF found with MAC fa:16:3e:80:bb:2c, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:26:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-35430a01-d549-4b08-811a-8d1089f39f7c tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.415s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:26:09 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:26:09 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:26:09 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:26:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:26:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:26:09 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:26:10 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Updating instance_info_cache with network_info: [{"id": "094f0848-c129-4499-8781-6943982188b6", "address": "fa:16:3e:44:2f:52", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094f0848-c1", "ovs_interfaceid": "094f0848-c129-4499-8781-6943982188b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:26:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:26:10 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:26:10 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:26:10 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:26:10 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:26:10 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:26:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:26:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:26:31 user nova-compute[75293]: INFO nova.compute.manager [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Detaching volume da9a06bf-e065-407c-83b4-f76bee1b9345
Nov 30 07:26:31 user nova-compute[75293]: INFO nova.virt.block_device [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Attempting to driver detach volume da9a06bf-e065-407c-83b4-f76bee1b9345 from mountpoint /dev/vdb
Nov 30 07:26:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Attempting to detach device vdb from instance 47068cdd-7fbb-4612-892e-bfdccdac9cbd from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:26:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:26:31 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:26:31 user nova-compute[75293]:   <source dev="/dev/sdf"/>
Nov 30 07:26:31 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:26:31 user nova-compute[75293]:   <serial>da9a06bf-e065-407c-83b4-f76bee1b9345</serial>
Nov 30 07:26:31 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:26:31 user nova-compute[75293]: </disk>
Nov 30 07:26:31 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:26:31 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Successfully detached device vdb from instance 47068cdd-7fbb-4612-892e-bfdccdac9cbd from the persistent domain config.
Nov 30 07:26:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 47068cdd-7fbb-4612-892e-bfdccdac9cbd from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:26:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:26:31 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:26:31 user nova-compute[75293]:   <source dev="/dev/sdf"/>
Nov 30 07:26:31 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:26:31 user nova-compute[75293]:   <serial>da9a06bf-e065-407c-83b4-f76bee1b9345</serial>
Nov 30 07:26:31 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:26:31 user nova-compute[75293]: </disk>
Nov 30 07:26:31 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:26:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:26:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:31 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 47068cdd-7fbb-4612-892e-bfdccdac9cbd {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:26:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-012b1cec-5519-4ae6-9f01-fe5521664d34 req-fdf87195-bcd8-47fc-a139-a30b90ec2a9c service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Received event network-changed-1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:26:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-012b1cec-5519-4ae6-9f01-fe5521664d34 req-fdf87195-bcd8-47fc-a139-a30b90ec2a9c service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Refreshing instance network info cache due to event network-changed-1582c6d0-9518-41fa-907e-7c64af37731b. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:26:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-012b1cec-5519-4ae6-9f01-fe5521664d34 req-fdf87195-bcd8-47fc-a139-a30b90ec2a9c service nova] Acquiring lock "refresh_cache-11e67339-be9e-481a-a8d2-8573caa97866" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:26:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-012b1cec-5519-4ae6-9f01-fe5521664d34 req-fdf87195-bcd8-47fc-a139-a30b90ec2a9c service nova] Acquired lock "refresh_cache-11e67339-be9e-481a-a8d2-8573caa97866" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:26:32 user nova-compute[75293]: DEBUG nova.network.neutron [req-012b1cec-5519-4ae6-9f01-fe5521664d34 req-fdf87195-bcd8-47fc-a139-a30b90ec2a9c service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Refreshing network info cache for port 1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:26:33 user nova-compute[75293]: DEBUG nova.network.neutron [req-012b1cec-5519-4ae6-9f01-fe5521664d34 req-fdf87195-bcd8-47fc-a139-a30b90ec2a9c service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Updated VIF entry in instance network info cache for port 1582c6d0-9518-41fa-907e-7c64af37731b. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:26:33 user nova-compute[75293]: DEBUG nova.network.neutron [req-012b1cec-5519-4ae6-9f01-fe5521664d34 req-fdf87195-bcd8-47fc-a139-a30b90ec2a9c service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Updating instance_info_cache with network_info: [{"id": "1582c6d0-9518-41fa-907e-7c64af37731b", "address": "fa:16:3e:88:c5:08", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1582c6d0-95", "ovs_interfaceid": "1582c6d0-9518-41fa-907e-7c64af37731b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:26:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-012b1cec-5519-4ae6-9f01-fe5521664d34 req-fdf87195-bcd8-47fc-a139-a30b90ec2a9c service nova] Releasing lock "refresh_cache-11e67339-be9e-481a-a8d2-8573caa97866" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:26:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "df4d31a0-33c1-49e2-a446-99454c82199b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:26:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "df4d31a0-33c1-49e2-a446-99454c82199b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:26:39 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:26:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:26:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:26:39 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:26:39 user nova-compute[75293]: INFO nova.compute.claims [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Claim successful on node user
Nov 30 07:26:40 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:26:40 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:26:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:26:40 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:26:40 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:26:40 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:26:40 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:26:40 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:26:40 user nova-compute[75293]: INFO nova.virt.block_device [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Booting with volume snapshot d97cafe6-6d66-48e1-ac1f-cf9734884bb9 at /dev/vda
Nov 30 07:26:40 user nova-compute[75293]: DEBUG nova.policy [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbee62d1b15144cc9d433a4a64dd12a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa84ea3874ba7ac0af4c3b1d2f918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:26:41 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Successfully created port: f50eec80-6c1a-4e32-aea2-4f3058a65b01 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:26:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:41 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Successfully updated port: f50eec80-6c1a-4e32-aea2-4f3058a65b01 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:26:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "refresh_cache-df4d31a0-33c1-49e2-a446-99454c82199b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:26:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquired lock "refresh_cache-df4d31a0-33c1-49e2-a446-99454c82199b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:26:42 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:26:42 user nova-compute[75293]: DEBUG nova.compute.manager [req-1e900cd9-29a9-4dbe-ab32-823f059bb242 req-f4ce7821-785c-4271-9108-915c982eb40f service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Received event network-changed-f50eec80-6c1a-4e32-aea2-4f3058a65b01 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:26:42 user nova-compute[75293]: DEBUG nova.compute.manager [req-1e900cd9-29a9-4dbe-ab32-823f059bb242 req-f4ce7821-785c-4271-9108-915c982eb40f service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Refreshing instance network info cache due to event network-changed-f50eec80-6c1a-4e32-aea2-4f3058a65b01. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:26:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1e900cd9-29a9-4dbe-ab32-823f059bb242 req-f4ce7821-785c-4271-9108-915c982eb40f service nova] Acquiring lock "refresh_cache-df4d31a0-33c1-49e2-a446-99454c82199b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:26:42 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:26:42 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Updating instance_info_cache with network_info: [{"id": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "address": "fa:16:3e:e9:a7:59", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50eec80-6c", "ovs_interfaceid": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:26:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Releasing lock "refresh_cache-df4d31a0-33c1-49e2-a446-99454c82199b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:26:42 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Instance network_info: |[{"id": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "address": "fa:16:3e:e9:a7:59", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50eec80-6c", "ovs_interfaceid": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:26:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1e900cd9-29a9-4dbe-ab32-823f059bb242 req-f4ce7821-785c-4271-9108-915c982eb40f service nova] Acquired lock "refresh_cache-df4d31a0-33c1-49e2-a446-99454c82199b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:26:42 user nova-compute[75293]: DEBUG nova.network.neutron [req-1e900cd9-29a9-4dbe-ab32-823f059bb242 req-f4ce7821-785c-4271-9108-915c982eb40f service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Refreshing network info cache for port f50eec80-6c1a-4e32-aea2-4f3058a65b01 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:26:42 user nova-compute[75293]: DEBUG nova.network.neutron [req-1e900cd9-29a9-4dbe-ab32-823f059bb242 req-f4ce7821-785c-4271-9108-915c982eb40f service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Updated VIF entry in instance network info cache for port f50eec80-6c1a-4e32-aea2-4f3058a65b01. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:26:42 user nova-compute[75293]: DEBUG nova.network.neutron [req-1e900cd9-29a9-4dbe-ab32-823f059bb242 req-f4ce7821-785c-4271-9108-915c982eb40f service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Updating instance_info_cache with network_info: [{"id": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "address": "fa:16:3e:e9:a7:59", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50eec80-6c", "ovs_interfaceid": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:26:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1e900cd9-29a9-4dbe-ab32-823f059bb242 req-f4ce7821-785c-4271-9108-915c982eb40f service nova] Releasing lock "refresh_cache-df4d31a0-33c1-49e2-a446-99454c82199b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG os_brick.utils [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c752c92-cbb4-4768-a6c1-ac6e9ba7c0ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97242c6-36e0-4300-bcd6-d02b3e2f54c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c48c49-ffa7-45d1-a496-e2387345eb99]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ee233f-19f5-4019-ac0d-7157245a46ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:26:46 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:26:46 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1166ed0d-7f28-4c0a-a9db-5309ba964a45]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG os_brick.utils [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Updating existing volume attachment record: c9c7a257-3b72-4697-b470-26637005420f {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75293) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:26:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:51 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 47068cdd-7fbb-4612-892e-bfdccdac9cbd is timed out.
Nov 30 07:26:51 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Successfully detached device vdb from instance 47068cdd-7fbb-4612-892e-bfdccdac9cbd from the live domain config.
Nov 30 07:26:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:26:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmxAvaBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:26:51 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:26:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:26:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:26:51 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccc79da-87b7-4606-9a25-cd69d1125511]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:26:52 user nova-compute[75293]: No targets found.
Nov 30 07:26:52 user nova-compute[75293]: iSNS:
Nov 30 07:26:52 user nova-compute[75293]: No targets found.
Nov 30 07:26:52 user nova-compute[75293]: STATIC:
Nov 30 07:26:52 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:26:52 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:26:52 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:26:52 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea
Nov 30 07:26:52 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:26:52 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:26:52 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345
Nov 30 07:26:52 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:26:52 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:26:52 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c
Nov 30 07:26:52 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:26:52 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:26:52 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf
Nov 30 07:26:52 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:26:52 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:26:52 user nova-compute[75293]: FIRMWARE:
Nov 30 07:26:52 user nova-compute[75293]: No targets found.
Nov 30 07:26:52 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:26:52 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:26:52 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa1c09a-f1e1-47d0-afe6-9808f2591b0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3b1457-c5ea-41c2-8dab-abecdef6e510]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:26:52 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:26:52 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:26:52 user nova-compute[75293]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:26:52 user nova-compute[75293]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 (non-flash)
Nov 30 07:26:52 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:26:52 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:26:52 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:26:52 user nova-compute[75293]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:26:52 user nova-compute[75293]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 (non-flash)
Nov 30 07:26:52 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe86a2170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345'): ({'sdf'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Removing single pathed devices sdf {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd4ab4b-0e26-4cce-a774-ef30de39ed16]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[69795e6b-f251-477c-aca7-19a33e42ce70]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Flushing IO for device /dev/sdf {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[90460d01-378a-4ad8-9aae-b8c1cba4345a]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ce62d5-d592-4b6d-95eb-60b74c9546ae]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] SCSI volumes sdf have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0025062-c17d-4f35-8bca-cffb40543039]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6295de03-c614-469a-a362-1e27a6ad85ea]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345, portal: 172.16.0.220,3260]
Nov 30 07:26:52 user nova-compute[75293]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345, portal: 172.16.0.220,3260] successful.
Nov 30 07:26:52 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49852f0-281b-4ba4-9aa6-e1788362710c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] <== disconnect_volume: return (301ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:26:52 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG nova.objects.instance [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lazy-loading 'flavor' on Instance uuid 47068cdd-7fbb-4612-892e-bfdccdac9cbd {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-943ac96f-a8b6-419b-a823-938aca118125 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.731s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.582s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:26:53 user nova-compute[75293]: INFO nova.compute.manager [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Terminating instance
Nov 30 07:26:53 user nova-compute[75293]: DEBUG nova.compute.manager [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG nova.compute.manager [req-56b7a8a6-34b1-417a-9e54-dd70a3896067 req-28e9a334-2037-4516-b2e2-dfa1409cd80f service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Received event network-vif-unplugged-0160f878-44ac-4d72-937c-4479bb41226d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-56b7a8a6-34b1-417a-9e54-dd70a3896067 req-28e9a334-2037-4516-b2e2-dfa1409cd80f service nova] Acquiring lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-56b7a8a6-34b1-417a-9e54-dd70a3896067 req-28e9a334-2037-4516-b2e2-dfa1409cd80f service nova] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-56b7a8a6-34b1-417a-9e54-dd70a3896067 req-28e9a334-2037-4516-b2e2-dfa1409cd80f service nova] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG nova.compute.manager [req-56b7a8a6-34b1-417a-9e54-dd70a3896067 req-28e9a334-2037-4516-b2e2-dfa1409cd80f service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] No waiting events found dispatching network-vif-unplugged-0160f878-44ac-4d72-937c-4479bb41226d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG nova.compute.manager [req-56b7a8a6-34b1-417a-9e54-dd70a3896067 req-28e9a334-2037-4516-b2e2-dfa1409cd80f service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Received event network-vif-unplugged-0160f878-44ac-4d72-937c-4479bb41226d for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:26:53 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Instance destroyed successfully.
Nov 30 07:26:53 user nova-compute[75293]: DEBUG nova.objects.instance [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lazy-loading 'resources' on Instance uuid 47068cdd-7fbb-4612-892e-bfdccdac9cbd {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-160652340',display_name='tempest-VolumesSnapshotTestJSON-instance-160652340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-160652340',id=39,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAirQXqAgz0frAhGtPxQdpRjKIW8W/6VepmdDqvZZ5ViOqv+ZmqnBccv3Teo/CugUTpu23hTXx/7UtXXWsJv7GX7ZsllqZ2GWU/YUv5ca0WUSlv0OzmEf5SN+kkS0ycNnw==',key_name='tempest-keypair-1275484145',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:24:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f979cf6621554018bbb90c09afd87c5a',ramdisk_id='',reservation_id='r-kekk2awn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-73863621',owner_user_name='tempest-VolumesSnapshotTestJSON-73863621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:24:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a86d36e3fa88466d9a047e9370468ecc',uuid=47068cdd-7fbb-4612-892e-bfdccdac9cbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0160f878-44ac-4d72-937c-4479bb41226d", "address": "fa:16:3e:80:bb:2c", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0160f878-44", "ovs_interfaceid": "0160f878-44ac-4d72-937c-4479bb41226d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Converting VIF {"id": "0160f878-44ac-4d72-937c-4479bb41226d", "address": "fa:16:3e:80:bb:2c", "network": {"id": "0f103825-2792-47bf-b5e2-1108396c6212", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-745061639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f979cf6621554018bbb90c09afd87c5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0160f878-44", "ovs_interfaceid": "0160f878-44ac-4d72-937c-4479bb41226d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=0160f878-44ac-4d72-937c-4479bb41226d,network=Network(0f103825-2792-47bf-b5e2-1108396c6212),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0160f878-44') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG os_vif [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=0160f878-44ac-4d72-937c-4479bb41226d,network=Network(0f103825-2792-47bf-b5e2-1108396c6212),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0160f878-44') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0160f878-44, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22ebab4a-f488-4b3c-9127-433d326d05c0) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:26:53 user nova-compute[75293]: INFO os_vif [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=0160f878-44ac-4d72-937c-4479bb41226d,network=Network(0f103825-2792-47bf-b5e2-1108396c6212),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0160f878-44')
Nov 30 07:26:53 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmxAvaBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:26:53 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:26:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d919b005-2546-4a58-baec-8232dc4d3f68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:26:53 user nova-compute[75293]: No targets found.
Nov 30 07:26:53 user nova-compute[75293]: iSNS:
Nov 30 07:26:53 user nova-compute[75293]: No targets found.
Nov 30 07:26:53 user nova-compute[75293]: STATIC:
Nov 30 07:26:53 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:26:53 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:26:53 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:26:53 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea
Nov 30 07:26:53 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:26:53 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:26:53 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c
Nov 30 07:26:53 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:26:53 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:26:53 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf
Nov 30 07:26:53 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:26:53 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:26:53 user nova-compute[75293]: FIRMWARE:
Nov 30 07:26:53 user nova-compute[75293]: No targets found.
Nov 30 07:26:53 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:26:53 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:26:53 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9a06bf-e065-407c-83b4-f76bee1b9345', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:26:53 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d14a06e-81c8-469c-afa0-797c56705065]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc110724-ccd8-441c-8075-0be5f6251433]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:26:54 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:26:54 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:26:54 user nova-compute[75293]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:26:54 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:26:54 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:26:54 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:26:54 user nova-compute[75293]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:26:54 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effc861e8c0>, {}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Disconnecting from: [] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] <== disconnect_volume: return (78ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:26:54 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Deleting instance files /opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd_del
Nov 30 07:26:54 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Deletion of /opt/stack/data/nova/instances/47068cdd-7fbb-4612-892e-bfdccdac9cbd_del complete
Nov 30 07:26:54 user nova-compute[75293]: INFO nova.compute.manager [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:26:54 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Creating image(s)
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Did not create local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Ensure instance console log exists: /opt/stack/data/nova/instances/df4d31a0-33c1-49e2-a446-99454c82199b/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Start _get_guest_xml network_info=[{"id": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "address": "fa:16:3e:e9:a7:59", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50eec80-6c", "ovs_interfaceid": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-30T07:26:34Z,direct_url=<?>,disk_format='qcow2',id=4c4d5218-816b-423c-ba49-74bf86acb793,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1547505836',owner='e4bfa84ea3874ba7ac0af4c3b1d2f918',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-30T07:26:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOEPZdrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'df4d31a0-33c1-49e2-a446-99454c82199b', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7436318-e6d4-409b-bc9f-ea0c62154fc0', 'serial': 'e7436318-e6d4-409b-bc9f-ea0c62154fc0'}, 'delete_on_termination': True, 'attachment_id': 'c9c7a257-3b72-4697-b470-26637005420f', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:26:54 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:26:54 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-30T07:26:34Z,direct_url=<?>,disk_format='qcow2',id=4c4d5218-816b-423c-ba49-74bf86acb793,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1547505836',owner='e4bfa84ea3874ba7ac0af4c3b1d2f918',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-30T07:26:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOEPZdrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:26:54 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:26:54 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:26:54 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[68913755-bece-4eb7-8c29-4ee55feb3a0f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:26:54 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf7521f-2eac-4d09-b7f7-ea639d90389d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0] added
Nov 30 07:26:54 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[511a92e7-e66a-4033-9144-347c51b58034]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[10461e50-db70-488b-aa26-47f76e53993a]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eOEPZdrR {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eOEPZdrR" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0b49f0-3062-4dda-8d49-c3150c99a097]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eOEPZdrR'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab8712a-afb1-4c57-8137-667e3e8b8720]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd76ae9-2249-491e-b3eb-222f3e5238c5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:26:54 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:26:54 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:26:54 user nova-compute[75293]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:26:54 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:26:54 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:26:54 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:26:54 user nova-compute[75293]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:26:54 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f43f3f-46e6-4bb7-b22b-38a91fb2ecb4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0, portal: 172.16.0.220,3260]
Nov 30 07:26:54 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0, portal: 172.16.0.220,3260] successful.
Nov 30 07:26:54 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad92c7f-9631-4a0e-99a3-448f880cb45e]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:26:54 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6ac066-10ec-4509-ad61-fb67d320eb34]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:26:55 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:26:55 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:26:55 user nova-compute[75293]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:26:55 user nova-compute[75293]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)
Nov 30 07:26:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:26:55 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:26:55 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:26:55 user nova-compute[75293]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:26:55 user nova-compute[75293]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)
Nov 30 07:26:55 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] HCTL ('37', '-', '-', 0) found on session 49 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.036s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a4822a-79d4-4bc3-af71-cb22dbb31d4e]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Searching for a device in session 49 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOEPZdrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:26:55 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Took 1.01 seconds to deallocate network for instance.
Nov 30 07:26:55 user nova-compute[75293]: DEBUG nova.compute.manager [req-44b24ba3-8f86-47e0-a6cf-8b45483b6638 req-515ff3ee-76c1-41b5-8a74-657ff24724a0 service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Received event network-vif-deleted-0160f878-44ac-4d72-937c-4479bb41226d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:26:55 user nova-compute[75293]: WARNING nova.volume.cinder [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Attachment 19403bdb-c471-41d4-853a-f8568dbfc716 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 19403bdb-c471-41d4-853a-f8568dbfc716. (HTTP 404) (Request-ID: req-95bac3d5-2038-442d-9353-5ce101f9b1ce)
Nov 30 07:26:55 user nova-compute[75293]: INFO nova.compute.manager [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Took 0.02 seconds to detach 1 volumes for instance.
Nov 30 07:26:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG nova.compute.manager [req-2814203a-3621-44da-8813-39a2ea600f22 req-e8011fba-118b-4252-b6e4-dc6e4a662850 service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Received event network-vif-plugged-0160f878-44ac-4d72-937c-4479bb41226d {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2814203a-3621-44da-8813-39a2ea600f22 req-e8011fba-118b-4252-b6e4-dc6e4a662850 service nova] Acquiring lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2814203a-3621-44da-8813-39a2ea600f22 req-e8011fba-118b-4252-b6e4-dc6e4a662850 service nova] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2814203a-3621-44da-8813-39a2ea600f22 req-e8011fba-118b-4252-b6e4-dc6e4a662850 service nova] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG nova.compute.manager [req-2814203a-3621-44da-8813-39a2ea600f22 req-e8011fba-118b-4252-b6e4-dc6e4a662850 service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] No waiting events found dispatching network-vif-plugged-0160f878-44ac-4d72-937c-4479bb41226d {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:26:55 user nova-compute[75293]: WARNING nova.compute.manager [req-2814203a-3621-44da-8813-39a2ea600f22 req-e8011fba-118b-4252-b6e4-dc6e4a662850 service nova] [instance: 47068cdd-7fbb-4612-892e-bfdccdac9cbd] Received unexpected event network-vif-plugged-0160f878-44ac-4d72-937c-4479bb41226d for instance with vm_state deleted and task_state None.
Nov 30 07:26:55 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:26:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:26:55 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Deleted allocations for instance 47068cdd-7fbb-4612-892e-bfdccdac9cbd
Nov 30 07:26:55 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9e8213fa-3db9-4729-aa37-4fed5107b065 tempest-VolumesSnapshotTestJSON-73863621 tempest-VolumesSnapshotTestJSON-73863621-project-member] Lock "47068cdd-7fbb-4612-892e-bfdccdac9cbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.533s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23835353963323439', 'path': '/dev/sdf'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835353963323439', 'path': '/dev/sdf'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1418291978',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1418291978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1418291978',id=42,image_ref='4c4d5218-816b-423c-ba49-74bf86acb793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZAyUybRyGIPSTkmWgT4OlypzVdNz6Byu6rMOK9BDsQrVsTWWDZdokkkTMV0KQGvzJ+2mLl8QtmdtSkXTmA9QhoAdQwA+rtdOWj3XEv2zzTWUIwxbX/LZiZsdMZ1vjCYw==',key_name='tempest-keypair-722633649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4bfa84ea3874ba7ac0af4c3b1d2f918',ramdisk_id='',reservation_id='r-v2jlp74w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-273596612',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-273596612-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273596612',owner_user_name='tempest-TestVolumeBootPattern-273596612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:26:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbee62d1b15144cc9d433a4a64dd12a7',uuid=df4d31a0-33c1-49e2-a446-99454c82199b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "address": "fa:16:3e:e9:a7:59", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50eec80-6c", "ovs_interfaceid": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converting VIF {"id": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "address": "fa:16:3e:e9:a7:59", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50eec80-6c", "ovs_interfaceid": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:a7:59,bridge_name='br-int',has_traffic_filtering=True,id=f50eec80-6c1a-4e32-aea2-4f3058a65b01,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf50eec80-6c') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG nova.objects.instance [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lazy-loading 'pci_devices' on Instance uuid df4d31a0-33c1-49e2-a446-99454c82199b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:26:56 user nova-compute[75293]:   <uuid>df4d31a0-33c1-49e2-a446-99454c82199b</uuid>
Nov 30 07:26:56 user nova-compute[75293]:   <name>instance-0000002a</name>
Nov 30 07:26:56 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:26:56 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:26:56 user nova-compute[75293]:   <metadata>
Nov 30 07:26:56 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:26:56 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:26:56 user nova-compute[75293]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1418291978</nova:name>
Nov 30 07:26:56 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:26:54</nova:creationTime>
Nov 30 07:26:56 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:26:56 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:26:56 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:26:56 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:26:56 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:26:56 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:26:56 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:26:56 user nova-compute[75293]:       <nova:owner>
Nov 30 07:26:56 user nova-compute[75293]:         <nova:user uuid="fbee62d1b15144cc9d433a4a64dd12a7">tempest-TestVolumeBootPattern-273596612-project-member</nova:user>
Nov 30 07:26:56 user nova-compute[75293]:         <nova:project uuid="e4bfa84ea3874ba7ac0af4c3b1d2f918">tempest-TestVolumeBootPattern-273596612</nova:project>
Nov 30 07:26:56 user nova-compute[75293]:       </nova:owner>
Nov 30 07:26:56 user nova-compute[75293]:       <nova:root type="image" uuid="4c4d5218-816b-423c-ba49-74bf86acb793"/>
Nov 30 07:26:56 user nova-compute[75293]:       <nova:ports>
Nov 30 07:26:56 user nova-compute[75293]:         <nova:port uuid="f50eec80-6c1a-4e32-aea2-4f3058a65b01">
Nov 30 07:26:56 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 30 07:26:56 user nova-compute[75293]:         </nova:port>
Nov 30 07:26:56 user nova-compute[75293]:       </nova:ports>
Nov 30 07:26:56 user nova-compute[75293]:     </nova:instance>
Nov 30 07:26:56 user nova-compute[75293]:   </metadata>
Nov 30 07:26:56 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:26:56 user nova-compute[75293]:     <system>
Nov 30 07:26:56 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:26:56 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:26:56 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:26:56 user nova-compute[75293]:       <entry name="serial">df4d31a0-33c1-49e2-a446-99454c82199b</entry>
Nov 30 07:26:56 user nova-compute[75293]:       <entry name="uuid">df4d31a0-33c1-49e2-a446-99454c82199b</entry>
Nov 30 07:26:56 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:26:56 user nova-compute[75293]:     </system>
Nov 30 07:26:56 user nova-compute[75293]:   </sysinfo>
Nov 30 07:26:56 user nova-compute[75293]:   <os>
Nov 30 07:26:56 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:26:56 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:26:56 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:26:56 user nova-compute[75293]:   </os>
Nov 30 07:26:56 user nova-compute[75293]:   <features>
Nov 30 07:26:56 user nova-compute[75293]:     <acpi/>
Nov 30 07:26:56 user nova-compute[75293]:     <apic/>
Nov 30 07:26:56 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:26:56 user nova-compute[75293]:   </features>
Nov 30 07:26:56 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:26:56 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:26:56 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:26:56 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:26:56 user nova-compute[75293]:   </clock>
Nov 30 07:26:56 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:26:56 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:26:56 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:26:56 user nova-compute[75293]:   </cpu>
Nov 30 07:26:56 user nova-compute[75293]:   <devices>
Nov 30 07:26:56 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:26:56 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:26:56 user nova-compute[75293]:       <source dev="/dev/sdf"/>
Nov 30 07:26:56 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:26:56 user nova-compute[75293]:       <serial>e7436318-e6d4-409b-bc9f-ea0c62154fc0</serial>
Nov 30 07:26:56 user nova-compute[75293]:     </disk>
Nov 30 07:26:56 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:26:56 user nova-compute[75293]:       <mac address="fa:16:3e:e9:a7:59"/>
Nov 30 07:26:56 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:26:56 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:26:56 user nova-compute[75293]:       <target dev="tapf50eec80-6c"/>
Nov 30 07:26:56 user nova-compute[75293]:     </interface>
Nov 30 07:26:56 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:26:56 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/df4d31a0-33c1-49e2-a446-99454c82199b/console.log" append="off"/>
Nov 30 07:26:56 user nova-compute[75293]:     </serial>
Nov 30 07:26:56 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:26:56 user nova-compute[75293]:     <video>
Nov 30 07:26:56 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:26:56 user nova-compute[75293]:     </video>
Nov 30 07:26:56 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:26:56 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:26:56 user nova-compute[75293]:     </rng>
Nov 30 07:26:56 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:26:56 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:26:56 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:26:56 user nova-compute[75293]:     </memballoon>
Nov 30 07:26:56 user nova-compute[75293]:   </devices>
Nov 30 07:26:56 user nova-compute[75293]: </domain>
Nov 30 07:26:56 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1418291978',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1418291978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1418291978',id=42,image_ref='4c4d5218-816b-423c-ba49-74bf86acb793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZAyUybRyGIPSTkmWgT4OlypzVdNz6Byu6rMOK9BDsQrVsTWWDZdokkkTMV0KQGvzJ+2mLl8QtmdtSkXTmA9QhoAdQwA+rtdOWj3XEv2zzTWUIwxbX/LZiZsdMZ1vjCYw==',key_name='tempest-keypair-722633649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4bfa84ea3874ba7ac0af4c3b1d2f918',ramdisk_id='',reservation_id='r-v2jlp74w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-273596612',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-273596612-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273596612',owner_user_name='tempest-TestVolumeBootPattern-273596612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:26:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbee62d1b15144cc9d433a4a64dd12a7',uuid=df4d31a0-33c1-49e2-a446-99454c82199b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "address": "fa:16:3e:e9:a7:59", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50eec80-6c", "ovs_interfaceid": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converting VIF {"id": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "address": "fa:16:3e:e9:a7:59", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50eec80-6c", "ovs_interfaceid": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:a7:59,bridge_name='br-int',has_traffic_filtering=True,id=f50eec80-6c1a-4e32-aea2-4f3058a65b01,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf50eec80-6c') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG os_vif [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:a7:59,bridge_name='br-int',has_traffic_filtering=True,id=f50eec80-6c1a-4e32-aea2-4f3058a65b01,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf50eec80-6c') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fbc53bc3-90e5-5db0-8c43-98b1772cea8c', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf50eec80-6c, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf50eec80-6c, col_values=(('qos', UUID('787e3e8c-6dc3-4046-bf43-c0ba6563eea7')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf50eec80-6c, col_values=(('external_ids', {'iface-id': 'f50eec80-6c1a-4e32-aea2-4f3058a65b01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:a7:59', 'vm-uuid': 'df4d31a0-33c1-49e2-a446-99454c82199b'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:56 user nova-compute[75293]: INFO os_vif [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:a7:59,bridge_name='br-int',has_traffic_filtering=True,id=f50eec80-6c1a-4e32-aea2-4f3058a65b01,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf50eec80-6c')
Nov 30 07:26:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:26:56 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] No VIF found with MAC fa:16:3e:e9:a7:59, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:26:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:57 user nova-compute[75293]: DEBUG nova.compute.manager [req-c4a19f12-d78c-404c-92ac-84b297a38703 req-2deb3e99-a282-43b4-96e7-22b0e938de36 service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Received event network-vif-plugged-f50eec80-6c1a-4e32-aea2-4f3058a65b01 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:26:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c4a19f12-d78c-404c-92ac-84b297a38703 req-2deb3e99-a282-43b4-96e7-22b0e938de36 service nova] Acquiring lock "df4d31a0-33c1-49e2-a446-99454c82199b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:26:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c4a19f12-d78c-404c-92ac-84b297a38703 req-2deb3e99-a282-43b4-96e7-22b0e938de36 service nova] Lock "df4d31a0-33c1-49e2-a446-99454c82199b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:26:57 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c4a19f12-d78c-404c-92ac-84b297a38703 req-2deb3e99-a282-43b4-96e7-22b0e938de36 service nova] Lock "df4d31a0-33c1-49e2-a446-99454c82199b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:26:57 user nova-compute[75293]: DEBUG nova.compute.manager [req-c4a19f12-d78c-404c-92ac-84b297a38703 req-2deb3e99-a282-43b4-96e7-22b0e938de36 service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] No waiting events found dispatching network-vif-plugged-f50eec80-6c1a-4e32-aea2-4f3058a65b01 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:26:57 user nova-compute[75293]: WARNING nova.compute.manager [req-c4a19f12-d78c-404c-92ac-84b297a38703 req-2deb3e99-a282-43b4-96e7-22b0e938de36 service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Received unexpected event network-vif-plugged-f50eec80-6c1a-4e32-aea2-4f3058a65b01 for instance with vm_state building and task_state spawning.
Nov 30 07:26:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:57 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:26:57 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:26:58 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:26:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:26:59 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:26:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:26:59 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Instance spawned successfully.
Nov 30 07:26:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:26:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:26:59 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:26:59 user nova-compute[75293]: INFO nova.compute.manager [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 30 07:26:59 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:26:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-ad3e3d93-71cf-4137-ab9c-46262dd4b529 req-09b1d33a-a34a-4ef2-ad6b-41543da25926 service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Received event network-vif-plugged-f50eec80-6c1a-4e32-aea2-4f3058a65b01 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:26:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ad3e3d93-71cf-4137-ab9c-46262dd4b529 req-09b1d33a-a34a-4ef2-ad6b-41543da25926 service nova] Acquiring lock "df4d31a0-33c1-49e2-a446-99454c82199b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:26:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ad3e3d93-71cf-4137-ab9c-46262dd4b529 req-09b1d33a-a34a-4ef2-ad6b-41543da25926 service nova] Lock "df4d31a0-33c1-49e2-a446-99454c82199b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:26:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ad3e3d93-71cf-4137-ab9c-46262dd4b529 req-09b1d33a-a34a-4ef2-ad6b-41543da25926 service nova] Lock "df4d31a0-33c1-49e2-a446-99454c82199b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:26:59 user nova-compute[75293]: DEBUG nova.compute.manager [req-ad3e3d93-71cf-4137-ab9c-46262dd4b529 req-09b1d33a-a34a-4ef2-ad6b-41543da25926 service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] No waiting events found dispatching network-vif-plugged-f50eec80-6c1a-4e32-aea2-4f3058a65b01 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:26:59 user nova-compute[75293]: WARNING nova.compute.manager [req-ad3e3d93-71cf-4137-ab9c-46262dd4b529 req-09b1d33a-a34a-4ef2-ad6b-41543da25926 service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Received unexpected event network-vif-plugged-f50eec80-6c1a-4e32-aea2-4f3058a65b01 for instance with vm_state building and task_state spawning.
Nov 30 07:26:59 user nova-compute[75293]: INFO nova.compute.manager [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Took 19.80 seconds to build instance.
Nov 30 07:26:59 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ef27e9a3-6e6a-4b14-83b5-5f57a67dcdd6 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "df4d31a0-33c1-49e2-a446-99454c82199b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.910s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:27:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:01 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:27:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:27:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:27:01 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:27:01 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:27:01 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:27:01 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:02 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:27:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67ad73a-2c4b-4cfe-acc5-e62d95d09318/disk.rescue --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67ad73a-2c4b-4cfe-acc5-e62d95d09318/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67ad73a-2c4b-4cfe-acc5-e62d95d09318/disk.rescue --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e67ad73a-2c4b-4cfe-acc5-e62d95d09318/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:02 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:27:02 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:27:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:27:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:04 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:27:04 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:27:04 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=8041MB free_disk=24.863513946533203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:27:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:27:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:27:04 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Applying migration context for instance d89452ef-96ab-4081-bc40-0f64968de367 as it has an incoming, in-progress migration 6830e03e-45db-4f4e-a180-42a1c39448d1. Migration status is finished {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 30 07:27:04 user nova-compute[75293]: INFO nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Updating resource usage from migration 6830e03e-45db-4f4e-a180-42a1c39448d1
Nov 30 07:27:04 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance c8d1df78-2aa2-4710-a570-5f72c60cfc26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:27:04 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:27:04 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 54c60b45-04dc-4d3b-96ec-c2d0f583cafa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:27:04 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance e67ad73a-2c4b-4cfe-acc5-e62d95d09318 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:27:04 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 11e67339-be9e-481a-a8d2-8573caa97866 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:27:04 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Migration 6830e03e-45db-4f4e-a180-42a1c39448d1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 30 07:27:04 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance d89452ef-96ab-4081-bc40-0f64968de367 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:27:04 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 2e215797-58b6-47bb-acbc-edd77e6cca2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:27:04 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance df4d31a0-33c1-49e2-a446-99454c82199b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:27:04 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:27:04 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=24GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:27:04 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:27:04 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:27:04 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:27:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:27:05 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:27:05 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:27:05 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:27:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-54c60b45-04dc-4d3b-96ec-c2d0f583cafa" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:27:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-54c60b45-04dc-4d3b-96ec-c2d0f583cafa" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:27:06 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:27:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:06 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Updating instance_info_cache with network_info: [{"id": "13a453d0-49aa-49ed-8032-18101893f071", "address": "fa:16:3e:59:47:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a453d0-49", "ovs_interfaceid": "13a453d0-49aa-49ed-8032-18101893f071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:27:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-54c60b45-04dc-4d3b-96ec-c2d0f583cafa" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:27:06 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:27:06 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:27:06 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:27:06 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:27:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:07 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:27:07 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:27:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:29 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Port 0b9bbab7-780f-4b09-9c9b-4448e8ff2323 binding to destination host user is already ACTIVE {{(pid=75293) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 30 07:27:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:27:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquired lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:27:29 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:27:29 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Updating instance_info_cache with network_info: [{"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:27:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Releasing lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:27:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Creating tmpfile /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/tmpzm_tp667 to verify with other compute node that the instance is on the same shared storage. {{(pid=75293) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 30 07:27:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-d6285308-69e6-46d4-99fd-2d6225bcaca0 req-a3e07e14-35ca-4304-9628-17b1da5ef35c service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received event network-vif-unplugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d6285308-69e6-46d4-99fd-2d6225bcaca0 req-a3e07e14-35ca-4304-9628-17b1da5ef35c service nova] Acquiring lock "d89452ef-96ab-4081-bc40-0f64968de367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d6285308-69e6-46d4-99fd-2d6225bcaca0 req-a3e07e14-35ca-4304-9628-17b1da5ef35c service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d6285308-69e6-46d4-99fd-2d6225bcaca0 req-a3e07e14-35ca-4304-9628-17b1da5ef35c service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-d6285308-69e6-46d4-99fd-2d6225bcaca0 req-a3e07e14-35ca-4304-9628-17b1da5ef35c service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] No waiting events found dispatching network-vif-unplugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:27:30 user nova-compute[75293]: WARNING nova.compute.manager [req-d6285308-69e6-46d4-99fd-2d6225bcaca0 req-a3e07e14-35ca-4304-9628-17b1da5ef35c service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received unexpected event network-vif-unplugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 for instance with vm_state resized and task_state resize_reverting.
Nov 30 07:27:30 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Instance destroyed successfully.
Nov 30 07:27:30 user nova-compute[75293]: DEBUG nova.objects.instance [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lazy-loading 'resources' on Instance uuid d89452ef-96ab-4081-bc40-0f64968de367 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1953113672',display_name='tempest-ServerActionsTestOtherB-server-1953113672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1953113672',id=35,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnRjCaWy780if2CkUOoZrcrdcD+P1g/YJnFZ7z8Y8pV7AT42ymHjcVO5HJTfrEuy5cWDNDXLYAnT+pwSMKRHRG0FXx2bJrOk/qq7N46wXruznAxyX6mXSnteMjD8Ewz6w==',key_name='tempest-keypair-319510887',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:26:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e631f0d47cc43a1b670e1b78b482e67',ramdisk_id='',reservation_id='r-mjklwfn9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-70269142',owner_user_name='tempest-ServerActionsTestOtherB-70269142-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:26:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fb08d8e90be4f6eb2efd21f2cbf2dcd',uuid=d89452ef-96ab-4081-bc40-0f64968de367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Converting VIF {"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_vif [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b9bbab7-78, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7bf9da6c-8caf-41af-b819-f0a5042f36a2) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:30 user nova-compute[75293]: INFO os_vif [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78')
Nov 30 07:27:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvteRwNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:27:30 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b42f03b-9a55-4ecc-88ee-25497ad9095e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:27:30 user nova-compute[75293]: No targets found.
Nov 30 07:27:30 user nova-compute[75293]: iSNS:
Nov 30 07:27:30 user nova-compute[75293]: No targets found.
Nov 30 07:27:30 user nova-compute[75293]: STATIC:
Nov 30 07:27:30 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0
Nov 30 07:27:30 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:27:30 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:27:30 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:27:30 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:27:30 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:27:30 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea
Nov 30 07:27:30 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:27:30 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:27:30 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c
Nov 30 07:27:30 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:27:30 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:27:30 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf
Nov 30 07:27:30 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:27:30 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:27:30 user nova-compute[75293]: FIRMWARE:
Nov 30 07:27:30 user nova-compute[75293]: No targets found.
Nov 30 07:27:30 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:27:30 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:27:30 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef155842-6ddc-45c1-8369-39e7713ff970]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7e92fc-6f61-4f36-8d1d-8cfe687b554f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:27:30 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:27:30 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:27:30 user nova-compute[75293]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:27:30 user nova-compute[75293]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)
Nov 30 07:27:30 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:27:30 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:27:30 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:27:30 user nova-compute[75293]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:27:30 user nova-compute[75293]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)
Nov 30 07:27:30 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe0361870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf'): ({'sdc'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Removing single pathed devices sdc {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0387b415-f18b-4426-9c99-47fc6f8d2192]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[876d0874-cf87-4d92-a67c-829b9fe85815]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Flushing IO for device /dev/sdc {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57da1d0-37d6-41a2-8f8b-d6300e354479]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb431093-0a92-41b7-baf8-751eb3e30998]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e173fa6-f6c3-4d6a-bd7f-708ace9090bb]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69c6461-3485-45d5-b92f-66e8b70d3204]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260]
Nov 30 07:27:30 user nova-compute[75293]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260] successful.
Nov 30 07:27:30 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d50f010-c483-4b20-9b53-bcebc30f6bf4]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] <== disconnect_volume: return (323ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:27:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:27:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:27:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:27:31 user nova-compute[75293]: DEBUG nova.objects.instance [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lazy-loading 'migration_context' on Instance uuid d89452ef-96ab-4081-bc40-0f64968de367 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:27:31 user nova-compute[75293]: DEBUG nova.objects.base [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Object Instance<d89452ef-96ab-4081-bc40-0f64968de367> lazy-loaded attributes: resources,migration_context {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:27:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-9f42e458-a3a6-4348-9a3e-e2df9ade6e3b req-8bab8a3f-a208-4efa-800f-cc57e7d82370 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received event network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:27:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9f42e458-a3a6-4348-9a3e-e2df9ade6e3b req-8bab8a3f-a208-4efa-800f-cc57e7d82370 service nova] Acquiring lock "d89452ef-96ab-4081-bc40-0f64968de367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:27:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9f42e458-a3a6-4348-9a3e-e2df9ade6e3b req-8bab8a3f-a208-4efa-800f-cc57e7d82370 service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:27:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9f42e458-a3a6-4348-9a3e-e2df9ade6e3b req-8bab8a3f-a208-4efa-800f-cc57e7d82370 service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:27:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-9f42e458-a3a6-4348-9a3e-e2df9ade6e3b req-8bab8a3f-a208-4efa-800f-cc57e7d82370 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] No waiting events found dispatching network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:27:32 user nova-compute[75293]: WARNING nova.compute.manager [req-9f42e458-a3a6-4348-9a3e-e2df9ade6e3b req-8bab8a3f-a208-4efa-800f-cc57e7d82370 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received unexpected event network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 for instance with vm_state resized and task_state resize_reverting.
Nov 30 07:27:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-04406feb-76b5-4fea-a7ba-ecb361c60b0f req-47936907-97d9-4f4d-84a2-1d3a43ac5947 service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Received event network-changed-9ff82ba5-78d7-420b-b9b3-b045ed2dcefd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:27:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-04406feb-76b5-4fea-a7ba-ecb361c60b0f req-47936907-97d9-4f4d-84a2-1d3a43ac5947 service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Refreshing instance network info cache due to event network-changed-9ff82ba5-78d7-420b-b9b3-b045ed2dcefd. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:27:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-04406feb-76b5-4fea-a7ba-ecb361c60b0f req-47936907-97d9-4f4d-84a2-1d3a43ac5947 service nova] Acquiring lock "refresh_cache-2e215797-58b6-47bb-acbc-edd77e6cca2d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:27:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-04406feb-76b5-4fea-a7ba-ecb361c60b0f req-47936907-97d9-4f4d-84a2-1d3a43ac5947 service nova] Acquired lock "refresh_cache-2e215797-58b6-47bb-acbc-edd77e6cca2d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:27:32 user nova-compute[75293]: DEBUG nova.network.neutron [req-04406feb-76b5-4fea-a7ba-ecb361c60b0f req-47936907-97d9-4f4d-84a2-1d3a43ac5947 service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Refreshing network info cache for port 9ff82ba5-78d7-420b-b9b3-b045ed2dcefd {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:27:32 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:27:32 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:27:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.386s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:27:32 user nova-compute[75293]: INFO nova.compute.manager [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Swapping old allocation on dict_keys(['82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa']) held by migration 6830e03e-45db-4f4e-a180-42a1c39448d1 for instance
Nov 30 07:27:32 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Overwriting current allocation {'allocations': {'82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 49}}, 'project_id': '2e631f0d47cc43a1b670e1b78b482e67', 'user_id': '6fb08d8e90be4f6eb2efd21f2cbf2dcd', 'consumer_generation': 1} on consumer d89452ef-96ab-4081-bc40-0f64968de367 {{(pid=75293) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 30 07:27:32 user nova-compute[75293]: DEBUG nova.network.neutron [req-04406feb-76b5-4fea-a7ba-ecb361c60b0f req-47936907-97d9-4f4d-84a2-1d3a43ac5947 service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Updated VIF entry in instance network info cache for port 9ff82ba5-78d7-420b-b9b3-b045ed2dcefd. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:27:32 user nova-compute[75293]: DEBUG nova.network.neutron [req-04406feb-76b5-4fea-a7ba-ecb361c60b0f req-47936907-97d9-4f4d-84a2-1d3a43ac5947 service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Updating instance_info_cache with network_info: [{"id": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "address": "fa:16:3e:e6:ca:88", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff82ba5-78", "ovs_interfaceid": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:27:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-04406feb-76b5-4fea-a7ba-ecb361c60b0f req-47936907-97d9-4f4d-84a2-1d3a43ac5947 service nova] Releasing lock "refresh_cache-2e215797-58b6-47bb-acbc-edd77e6cca2d" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:27:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:27:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquired lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:27:32 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG nova.network.neutron [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Updating instance_info_cache with network_info: [{"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Releasing lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG os_brick.utils [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb92536a-c6c8-412c-b03f-265cccc8e0da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6c7701-cc4a-452b-b547-74ba843f359f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b65933-e356-466a-930b-7e5533c562ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[820506f1-7431-4d28-b5d1-4d4040bb75e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:27:33 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:27:33 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e4021c-ad3d-496f-836a-39e7d8d6547d]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:27:33 user nova-compute[75293]: DEBUG os_brick.utils [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:27:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "2e215797-58b6-47bb-acbc-edd77e6cca2d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:27:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:27:34 user nova-compute[75293]: DEBUG nova.objects.instance [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lazy-loading 'flavor' on Instance uuid 2e215797-58b6-47bb-acbc-edd77e6cca2d {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "2e215797-58b6-47bb-acbc-edd77e6cca2d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:27:35 user nova-compute[75293]: INFO nova.compute.manager [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Attaching volume 5ed5e68f-d888-44d4-8cb4-8af1280073c9 to /dev/vdb
Nov 30 07:27:35 user nova-compute[75293]: DEBUG os_brick.utils [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cd9d93-ee2c-44f5-bc7e-727cc73190e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8520459e-04fa-42a2-8ad0-accb4dd5b1ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ea0c06-eb08-4b78-b263-9646b755809f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff369382-061b-49e6-86ed-dccec94dfbb3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:27:35 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:27:35 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d223a398-410c-4f7b-9337-8e88c55dc5c1]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG os_brick.utils [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Updating existing volume attachment record: 8f73c20d-ea16-4e50-8e21-14f154d5cdf2 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:27:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:42 user nova-compute[75293]: INFO nova.compute.manager [None req-a7b71077-a0a3-4b18-be99-d0b8d6aa80d6 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Unrescuing
Nov 30 07:27:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a7b71077-a0a3-4b18-be99-d0b8d6aa80d6 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "refresh_cache-e67ad73a-2c4b-4cfe-acc5-e62d95d09318" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:27:42 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a7b71077-a0a3-4b18-be99-d0b8d6aa80d6 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquired lock "refresh_cache-e67ad73a-2c4b-4cfe-acc5-e62d95d09318" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:27:42 user nova-compute[75293]: DEBUG nova.network.neutron [None req-a7b71077-a0a3-4b18-be99-d0b8d6aa80d6 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:27:43 user nova-compute[75293]: DEBUG nova.network.neutron [None req-a7b71077-a0a3-4b18-be99-d0b8d6aa80d6 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Updating instance_info_cache with network_info: [{"id": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "address": "fa:16:3e:80:e5:cd", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce63f6a4-44", "ovs_interfaceid": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:27:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a7b71077-a0a3-4b18-be99-d0b8d6aa80d6 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Releasing lock "refresh_cache-e67ad73a-2c4b-4cfe-acc5-e62d95d09318" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:27:43 user nova-compute[75293]: DEBUG nova.objects.instance [None req-a7b71077-a0a3-4b18-be99-d0b8d6aa80d6 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'flavor' on Instance uuid e67ad73a-2c4b-4cfe-acc5-e62d95d09318 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:27:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-844b1ea8-dfea-45e5-a2d1-87bdf4a67bad req-8ded4334-9899-4187-8857-fad2d495d9b2 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received event network-vif-unplugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:27:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-844b1ea8-dfea-45e5-a2d1-87bdf4a67bad req-8ded4334-9899-4187-8857-fad2d495d9b2 service nova] Acquiring lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:27:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-844b1ea8-dfea-45e5-a2d1-87bdf4a67bad req-8ded4334-9899-4187-8857-fad2d495d9b2 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:27:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-844b1ea8-dfea-45e5-a2d1-87bdf4a67bad req-8ded4334-9899-4187-8857-fad2d495d9b2 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:27:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-844b1ea8-dfea-45e5-a2d1-87bdf4a67bad req-8ded4334-9899-4187-8857-fad2d495d9b2 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] No waiting events found dispatching network-vif-unplugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:27:43 user nova-compute[75293]: WARNING nova.compute.manager [req-844b1ea8-dfea-45e5-a2d1-87bdf4a67bad req-8ded4334-9899-4187-8857-fad2d495d9b2 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received unexpected event network-vif-unplugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 for instance with vm_state rescued and task_state unrescuing.
Nov 30 07:27:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:43 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Instance destroyed successfully.
Nov 30 07:27:44 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'poiXcabv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:27:44 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:27:44 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:27:44 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2b5a07-3967-4885-977c-5101032e50b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:27:44 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[818bb62a-e0ef-4971-b92f-5184d1bb1c7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9] added
Nov 30 07:27:44 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[07876b08-b52c-4fd7-9803-43b40a5f013c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a46056-cf9f-4b1f-a485-bb1e13630008]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v poiXcabv {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v poiXcabv" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e234975-d0f4-4e27-aad2-b868f6c43cd9]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'poiXcabv'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fe7450-2111-4344-8926-cbd21d30b3be]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fc641f-78fb-4cb4-9f99-e7f40cb6720a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:27:44 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:27:44 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:27:44 user nova-compute[75293]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)
Nov 30 07:27:44 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:27:44 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:27:44 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:27:44 user nova-compute[75293]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)
Nov 30 07:27:44 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d48fe88-d1ab-4f55-b267-9ff931468050]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9, portal: 172.16.0.220,3260]
Nov 30 07:27:44 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9, portal: 172.16.0.220,3260] successful.
Nov 30 07:27:44 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bff124-efd3-43ad-9d96-cd6bf0e3cc14]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b5a4bf-bf90-4604-992f-4af6286ad6dd]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:27:44 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:27:44 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:27:44 user nova-compute[75293]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)
Nov 30 07:27:44 user nova-compute[75293]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 (non-flash)
Nov 30 07:27:44 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:27:44 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:27:44 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:27:44 user nova-compute[75293]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)
Nov 30 07:27:44 user nova-compute[75293]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 (non-flash)
Nov 30 07:27:44 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8b1aba-35ce-4afa-87a0-4248f6a8f696]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:27:44 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'poiXcabv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG nova.compute.manager [req-fffea0aa-e2f8-47c6-8a49-c85086909dcb req-1dfd9057-a7be-4d40-b794-a0ef6ed0a21b service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fffea0aa-e2f8-47c6-8a49-c85086909dcb req-1dfd9057-a7be-4d40-b794-a0ef6ed0a21b service nova] Acquiring lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fffea0aa-e2f8-47c6-8a49-c85086909dcb req-1dfd9057-a7be-4d40-b794-a0ef6ed0a21b service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fffea0aa-e2f8-47c6-8a49-c85086909dcb req-1dfd9057-a7be-4d40-b794-a0ef6ed0a21b service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG nova.compute.manager [req-fffea0aa-e2f8-47c6-8a49-c85086909dcb req-1dfd9057-a7be-4d40-b794-a0ef6ed0a21b service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] No waiting events found dispatching network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:27:45 user nova-compute[75293]: WARNING nova.compute.manager [req-fffea0aa-e2f8-47c6-8a49-c85086909dcb req-1dfd9057-a7be-4d40-b794-a0ef6ed0a21b service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received unexpected event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 for instance with vm_state rescued and task_state unrescuing.
Nov 30 07:27:45 user nova-compute[75293]: DEBUG nova.compute.manager [req-fffea0aa-e2f8-47c6-8a49-c85086909dcb req-1dfd9057-a7be-4d40-b794-a0ef6ed0a21b service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fffea0aa-e2f8-47c6-8a49-c85086909dcb req-1dfd9057-a7be-4d40-b794-a0ef6ed0a21b service nova] Acquiring lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fffea0aa-e2f8-47c6-8a49-c85086909dcb req-1dfd9057-a7be-4d40-b794-a0ef6ed0a21b service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-fffea0aa-e2f8-47c6-8a49-c85086909dcb req-1dfd9057-a7be-4d40-b794-a0ef6ed0a21b service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG nova.compute.manager [req-fffea0aa-e2f8-47c6-8a49-c85086909dcb req-1dfd9057-a7be-4d40-b794-a0ef6ed0a21b service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] No waiting events found dispatching network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:27:45 user nova-compute[75293]: WARNING nova.compute.manager [req-fffea0aa-e2f8-47c6-8a49-c85086909dcb req-1dfd9057-a7be-4d40-b794-a0ef6ed0a21b service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received unexpected event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 for instance with vm_state rescued and task_state unrescuing.
Nov 30 07:27:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26231393931343964', 'path': '/dev/sdc'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231393931343964', 'path': '/dev/sdc'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG nova.objects.instance [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lazy-loading 'flavor' on Instance uuid 2e215797-58b6-47bb-acbc-edd77e6cca2d {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:27:45 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] attach device xml: <disk type="block" device="disk">
Nov 30 07:27:45 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:27:45 user nova-compute[75293]:   <source dev="/dev/sdc"/>
Nov 30 07:27:45 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:27:45 user nova-compute[75293]:   <serial>5ed5e68f-d888-44d4-8cb4-8af1280073c9</serial>
Nov 30 07:27:45 user nova-compute[75293]: </disk>
Nov 30 07:27:45 user nova-compute[75293]:  {{(pid=75293) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 30 07:27:46 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:27:46 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:27:46 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] No VIF found with MAC fa:16:3e:e6:ca:88, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:27:46 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5e8a6586-e13d-4f95-9c28-0fde77fb4d4e tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.127s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:27:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:47 user nova-compute[75293]: DEBUG nova.compute.manager [None req-a7b71077-a0a3-4b18-be99-d0b8d6aa80d6 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:27:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "2e215797-58b6-47bb-acbc-edd77e6cca2d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:27:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:27:47 user nova-compute[75293]: INFO nova.compute.manager [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Detaching volume 5ed5e68f-d888-44d4-8cb4-8af1280073c9
Nov 30 07:27:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-83a556be-34f6-47fb-8dcf-4ff357d730a7 req-c37f4f96-5709-4211-9f51-81e5f2ae1178 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:27:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-83a556be-34f6-47fb-8dcf-4ff357d730a7 req-c37f4f96-5709-4211-9f51-81e5f2ae1178 service nova] Acquiring lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:27:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-83a556be-34f6-47fb-8dcf-4ff357d730a7 req-c37f4f96-5709-4211-9f51-81e5f2ae1178 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:27:47 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-83a556be-34f6-47fb-8dcf-4ff357d730a7 req-c37f4f96-5709-4211-9f51-81e5f2ae1178 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:27:47 user nova-compute[75293]: DEBUG nova.compute.manager [req-83a556be-34f6-47fb-8dcf-4ff357d730a7 req-c37f4f96-5709-4211-9f51-81e5f2ae1178 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] No waiting events found dispatching network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:27:47 user nova-compute[75293]: WARNING nova.compute.manager [req-83a556be-34f6-47fb-8dcf-4ff357d730a7 req-c37f4f96-5709-4211-9f51-81e5f2ae1178 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received unexpected event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 for instance with vm_state active and task_state None.
Nov 30 07:27:47 user nova-compute[75293]: INFO nova.virt.block_device [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Attempting to driver detach volume 5ed5e68f-d888-44d4-8cb4-8af1280073c9 from mountpoint /dev/vdb
Nov 30 07:27:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Attempting to detach device vdb from instance 2e215797-58b6-47bb-acbc-edd77e6cca2d from the persistent domain config. {{(pid=75293) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 30 07:27:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:27:47 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:27:47 user nova-compute[75293]:   <source dev="/dev/sdc"/>
Nov 30 07:27:47 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:27:47 user nova-compute[75293]:   <serial>5ed5e68f-d888-44d4-8cb4-8af1280073c9</serial>
Nov 30 07:27:47 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:27:47 user nova-compute[75293]: </disk>
Nov 30 07:27:47 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:27:47 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Successfully detached device vdb from instance 2e215797-58b6-47bb-acbc-edd77e6cca2d from the persistent domain config.
Nov 30 07:27:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2e215797-58b6-47bb-acbc-edd77e6cca2d from the live domain config. {{(pid=75293) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 30 07:27:47 user nova-compute[75293]: DEBUG nova.virt.libvirt.guest [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] detach device xml: <disk type="block" device="disk">
Nov 30 07:27:47 user nova-compute[75293]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:27:47 user nova-compute[75293]:   <source dev="/dev/sdc"/>
Nov 30 07:27:47 user nova-compute[75293]:   <target dev="vdb" bus="virtio"/>
Nov 30 07:27:47 user nova-compute[75293]:   <serial>5ed5e68f-d888-44d4-8cb4-8af1280073c9</serial>
Nov 30 07:27:47 user nova-compute[75293]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 30 07:27:47 user nova-compute[75293]: </disk>
Nov 30 07:27:47 user nova-compute[75293]:  {{(pid=75293) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 30 07:27:48 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2e215797-58b6-47bb-acbc-edd77e6cca2d {{(pid=75293) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Starting finish_revert_migration {{(pid=75293) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Start _get_guest_xml network_info=[{"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvteRwNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd89452ef-96ab-4081-bc40-0f64968de367', 'attached_at': '2023-11-30T07:27:50.000000', 'detached_at': '', 'volume_id': '9e982db5-ba1e-4b95-a127-1b44b7d7c6cf', 'serial': '9e982db5-ba1e-4b95-a127-1b44b7d7c6cf'}, 'delete_on_termination': False, 'attachment_id': 'e4cb395c-dc67-4185-b629-451cbc570caa', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75293) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 07:27:49 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:27:49 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.objects.instance [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lazy-loading 'vcpu_model' on Instance uuid d89452ef-96ab-4081-bc40-0f64968de367 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvteRwNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:27:49 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:27:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:27:49 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:27:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:27:49 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:27:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4bd320-fb2f-4520-a9a0-e519af63e2cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:27:49 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f00d6e1-fb66-48b9-89b2-5661783e58fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf] added
Nov 30 07:27:49 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20dedd2-95da-4179-b3a3-93cce6a8a91e]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0fd7f0-15e8-4d45-93ce-6b10e4fd2e4a]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dvteRwNq {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dvteRwNq" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[edccb170-1ece-4c0e-95e9-8afa19d59c04]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dvteRwNq'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:27:49 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c7833e-4af8-49ff-b8bd-d6bd0cc53c72]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d77de9-622f-4a63-8cb0-86683d42a540]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:27:50 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:27:50 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:27:50 user nova-compute[75293]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)
Nov 30 07:27:50 user nova-compute[75293]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 (non-flash)
Nov 30 07:27:50 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:27:50 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:27:50 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:27:50 user nova-compute[75293]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)
Nov 30 07:27:50 user nova-compute[75293]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 (non-flash)
Nov 30 07:27:50 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ee635d-d898-423f-8b71-50152862656f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260]
Nov 30 07:27:50 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260] successful.
Nov 30 07:27:50 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c7c0a4-908f-445c-aca0-cd608f6dd53f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ba9bf6-22ba-47ca-bf5a-02b697517276]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:27:50 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:27:50 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:27:50 user nova-compute[75293]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)
Nov 30 07:27:50 user nova-compute[75293]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 (non-flash)
Nov 30 07:27:50 user nova-compute[75293]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:27:50 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:27:50 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:27:50 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:27:50 user nova-compute[75293]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)
Nov 30 07:27:50 user nova-compute[75293]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 (non-flash)
Nov 30 07:27:50 user nova-compute[75293]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:27:50 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] HCTL ('38', '-', '-', 0) found on session 51 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e519c7-40cf-491e-8b7c-9a226d2cf71a]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Searching for a device in session 51 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvteRwNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:27:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23831383437346332', 'path': '/dev/sdg'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831383437346332', 'path': '/dev/sdg'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1953113672',display_name='tempest-ServerActionsTestOtherB-server-1953113672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1953113672',id=35,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnRjCaWy780if2CkUOoZrcrdcD+P1g/YJnFZ7z8Y8pV7AT42ymHjcVO5HJTfrEuy5cWDNDXLYAnT+pwSMKRHRG0FXx2bJrOk/qq7N46wXruznAxyX6mXSnteMjD8Ewz6w==',key_name='tempest-keypair-319510887',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:26:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2e631f0d47cc43a1b670e1b78b482e67',ramdisk_id='',reservation_id='r-mjklwfn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-70269142',owner_user_name='tempest-ServerActionsTestOtherB-70269142-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fb08d8e90be4f6eb2efd21f2cbf2dcd',uuid=d89452ef-96ab-4081-bc40-0f64968de367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Converting VIF {"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:27:51 user nova-compute[75293]:   <uuid>d89452ef-96ab-4081-bc40-0f64968de367</uuid>
Nov 30 07:27:51 user nova-compute[75293]:   <name>instance-00000023</name>
Nov 30 07:27:51 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:27:51 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:27:51 user nova-compute[75293]:   <metadata>
Nov 30 07:27:51 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:27:51 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:27:51 user nova-compute[75293]:       <nova:name>tempest-ServerActionsTestOtherB-server-1953113672</nova:name>
Nov 30 07:27:51 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:27:49</nova:creationTime>
Nov 30 07:27:51 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:27:51 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:27:51 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:27:51 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:27:51 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:27:51 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:27:51 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:27:51 user nova-compute[75293]:       <nova:owner>
Nov 30 07:27:51 user nova-compute[75293]:         <nova:user uuid="6fb08d8e90be4f6eb2efd21f2cbf2dcd">tempest-ServerActionsTestOtherB-70269142-project-member</nova:user>
Nov 30 07:27:51 user nova-compute[75293]:         <nova:project uuid="2e631f0d47cc43a1b670e1b78b482e67">tempest-ServerActionsTestOtherB-70269142</nova:project>
Nov 30 07:27:51 user nova-compute[75293]:       </nova:owner>
Nov 30 07:27:51 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:27:51 user nova-compute[75293]:       <nova:ports>
Nov 30 07:27:51 user nova-compute[75293]:         <nova:port uuid="0b9bbab7-780f-4b09-9c9b-4448e8ff2323">
Nov 30 07:27:51 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 30 07:27:51 user nova-compute[75293]:         </nova:port>
Nov 30 07:27:51 user nova-compute[75293]:       </nova:ports>
Nov 30 07:27:51 user nova-compute[75293]:     </nova:instance>
Nov 30 07:27:51 user nova-compute[75293]:   </metadata>
Nov 30 07:27:51 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:27:51 user nova-compute[75293]:     <system>
Nov 30 07:27:51 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:27:51 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:27:51 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:27:51 user nova-compute[75293]:       <entry name="serial">d89452ef-96ab-4081-bc40-0f64968de367</entry>
Nov 30 07:27:51 user nova-compute[75293]:       <entry name="uuid">d89452ef-96ab-4081-bc40-0f64968de367</entry>
Nov 30 07:27:51 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:27:51 user nova-compute[75293]:     </system>
Nov 30 07:27:51 user nova-compute[75293]:   </sysinfo>
Nov 30 07:27:51 user nova-compute[75293]:   <os>
Nov 30 07:27:51 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:27:51 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:27:51 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:27:51 user nova-compute[75293]:   </os>
Nov 30 07:27:51 user nova-compute[75293]:   <features>
Nov 30 07:27:51 user nova-compute[75293]:     <acpi/>
Nov 30 07:27:51 user nova-compute[75293]:     <apic/>
Nov 30 07:27:51 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:27:51 user nova-compute[75293]:   </features>
Nov 30 07:27:51 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:27:51 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:27:51 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:27:51 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:27:51 user nova-compute[75293]:   </clock>
Nov 30 07:27:51 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:27:51 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:27:51 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:27:51 user nova-compute[75293]:   </cpu>
Nov 30 07:27:51 user nova-compute[75293]:   <devices>
Nov 30 07:27:51 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:27:51 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:27:51 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk"/>
Nov 30 07:27:51 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:27:51 user nova-compute[75293]:     </disk>
Nov 30 07:27:51 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:27:51 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:27:51 user nova-compute[75293]:       <source dev="/dev/sdg"/>
Nov 30 07:27:51 user nova-compute[75293]:       <target dev="vdb" bus="virtio"/>
Nov 30 07:27:51 user nova-compute[75293]:       <serial>9e982db5-ba1e-4b95-a127-1b44b7d7c6cf</serial>
Nov 30 07:27:51 user nova-compute[75293]:     </disk>
Nov 30 07:27:51 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:27:51 user nova-compute[75293]:       <mac address="fa:16:3e:8c:ff:ac"/>
Nov 30 07:27:51 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:27:51 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:27:51 user nova-compute[75293]:       <target dev="tap0b9bbab7-78"/>
Nov 30 07:27:51 user nova-compute[75293]:     </interface>
Nov 30 07:27:51 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:27:51 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/console.log" append="off"/>
Nov 30 07:27:51 user nova-compute[75293]:     </serial>
Nov 30 07:27:51 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:27:51 user nova-compute[75293]:     <video>
Nov 30 07:27:51 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:27:51 user nova-compute[75293]:     </video>
Nov 30 07:27:51 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:27:51 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:27:51 user nova-compute[75293]:     </rng>
Nov 30 07:27:51 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:27:51 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:27:51 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:27:51 user nova-compute[75293]:     </memballoon>
Nov 30 07:27:51 user nova-compute[75293]:   </devices>
Nov 30 07:27:51 user nova-compute[75293]: </domain>
Nov 30 07:27:51 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1953113672',display_name='tempest-ServerActionsTestOtherB-server-1953113672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1953113672',id=35,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnRjCaWy780if2CkUOoZrcrdcD+P1g/YJnFZ7z8Y8pV7AT42ymHjcVO5HJTfrEuy5cWDNDXLYAnT+pwSMKRHRG0FXx2bJrOk/qq7N46wXruznAxyX6mXSnteMjD8Ewz6w==',key_name='tempest-keypair-319510887',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:26:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2e631f0d47cc43a1b670e1b78b482e67',ramdisk_id='',reservation_id='r-mjklwfn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-70269142',owner_user_name='tempest-ServerActionsTestOtherB-70269142-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fb08d8e90be4f6eb2efd21f2cbf2dcd',uuid=d89452ef-96ab-4081-bc40-0f64968de367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Converting VIF {"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG os_vif [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7250f6d9-b0d5-5c3e-b2da-7787ad110cdc', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b9bbab7-78, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b9bbab7-78, col_values=(('qos', UUID('1ea0249b-798a-4da9-aed9-e20754d2a83b')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b9bbab7-78, col_values=(('external_ids', {'iface-id': '0b9bbab7-780f-4b09-9c9b-4448e8ff2323', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:ff:ac', 'vm-uuid': 'd89452ef-96ab-4081-bc40-0f64968de367'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:27:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:51 user nova-compute[75293]: INFO os_vif [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78')
Nov 30 07:27:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:52 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:52 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:52 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:52 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:52 user nova-compute[75293]: DEBUG nova.compute.manager [req-2bebbcdf-cc57-4990-beab-5358009d2298 req-36201e9f-30d9-484c-9f90-9838ba1dd13b service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received event network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:27:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2bebbcdf-cc57-4990-beab-5358009d2298 req-36201e9f-30d9-484c-9f90-9838ba1dd13b service nova] Acquiring lock "d89452ef-96ab-4081-bc40-0f64968de367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:27:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2bebbcdf-cc57-4990-beab-5358009d2298 req-36201e9f-30d9-484c-9f90-9838ba1dd13b service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:27:52 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2bebbcdf-cc57-4990-beab-5358009d2298 req-36201e9f-30d9-484c-9f90-9838ba1dd13b service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:27:52 user nova-compute[75293]: DEBUG nova.compute.manager [req-2bebbcdf-cc57-4990-beab-5358009d2298 req-36201e9f-30d9-484c-9f90-9838ba1dd13b service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] No waiting events found dispatching network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:27:52 user nova-compute[75293]: WARNING nova.compute.manager [req-2bebbcdf-cc57-4990-beab-5358009d2298 req-36201e9f-30d9-484c-9f90-9838ba1dd13b service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received unexpected event network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 for instance with vm_state resized and task_state resize_reverting.
Nov 30 07:27:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:54 user nova-compute[75293]: DEBUG nova.compute.manager [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:27:54 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Instance running successfully.
Nov 30 07:27:54 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] finish_revert_migration finished successfully. {{(pid=75293) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 30 07:27:54 user nova-compute[75293]: DEBUG nova.compute.manager [req-8f6b20df-7c69-4a0e-9be4-70f19c0d2e78 req-36fffc6a-d6da-4b43-bdd8-b24e3585a294 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received event network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:27:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8f6b20df-7c69-4a0e-9be4-70f19c0d2e78 req-36fffc6a-d6da-4b43-bdd8-b24e3585a294 service nova] Acquiring lock "d89452ef-96ab-4081-bc40-0f64968de367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:27:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8f6b20df-7c69-4a0e-9be4-70f19c0d2e78 req-36fffc6a-d6da-4b43-bdd8-b24e3585a294 service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:27:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8f6b20df-7c69-4a0e-9be4-70f19c0d2e78 req-36fffc6a-d6da-4b43-bdd8-b24e3585a294 service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:27:54 user nova-compute[75293]: DEBUG nova.compute.manager [req-8f6b20df-7c69-4a0e-9be4-70f19c0d2e78 req-36fffc6a-d6da-4b43-bdd8-b24e3585a294 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] No waiting events found dispatching network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:27:54 user nova-compute[75293]: WARNING nova.compute.manager [req-8f6b20df-7c69-4a0e-9be4-70f19c0d2e78 req-36fffc6a-d6da-4b43-bdd8-b24e3585a294 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received unexpected event network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 for instance with vm_state resized and task_state resize_reverting.
Nov 30 07:27:55 user nova-compute[75293]: INFO nova.compute.manager [None req-f94111cd-6f29-40fc-81fb-a1421e3d660d tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Updating instance to original state: 'active'
Nov 30 07:27:55 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:27:55 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Cleaning up deleted instances {{(pid=75293) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 07:27:55 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] There are 0 instances to clean {{(pid=75293) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 07:27:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:27:57 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:27:57 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:27:58 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:28:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:02 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:28:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:28:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:28:02 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:28:02 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:28:02 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:28:02 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:28:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:28:03 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:28:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:03 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:28:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:05 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:28:05 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:28:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=8055MB free_disk=24.881622314453125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance c8d1df78-2aa2-4710-a570-5f72c60cfc26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 54c60b45-04dc-4d3b-96ec-c2d0f583cafa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance e67ad73a-2c4b-4cfe-acc5-e62d95d09318 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 11e67339-be9e-481a-a8d2-8573caa97866 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance d89452ef-96ab-4081-bc40-0f64968de367 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 2e215797-58b6-47bb-acbc-edd77e6cca2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance df4d31a0-33c1-49e2-a446-99454c82199b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Refreshing inventories for resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Updating ProviderTree inventory for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Updating inventory in ProviderTree for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Refreshing aggregate associations for resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa, aggregates: None {{(pid=75293) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Refreshing trait associations for resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV {{(pid=75293) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:28:05 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.822s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:28:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:06 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:28:06 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:28:06 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:28:06 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:28:07 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:28:07 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:28:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:28:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:28:07 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:28:08 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2e215797-58b6-47bb-acbc-edd77e6cca2d is timed out.
Nov 30 07:28:08 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Successfully detached device vdb from instance 2e215797-58b6-47bb-acbc-edd77e6cca2d from the live domain config.
Nov 30 07:28:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'poiXcabv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:28:08 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f609cb90-0226-47a2-b83a-661b4701a38b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:28:08 user nova-compute[75293]: No targets found.
Nov 30 07:28:08 user nova-compute[75293]: iSNS:
Nov 30 07:28:08 user nova-compute[75293]: No targets found.
Nov 30 07:28:08 user nova-compute[75293]: STATIC:
Nov 30 07:28:08 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0
Nov 30 07:28:08 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:28:08 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:28:08 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:28:08 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:28:08 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:28:08 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea
Nov 30 07:28:08 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:28:08 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:28:08 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c
Nov 30 07:28:08 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:28:08 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:28:08 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf
Nov 30 07:28:08 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:28:08 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:28:08 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9
Nov 30 07:28:08 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:28:08 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:28:08 user nova-compute[75293]: FIRMWARE:
Nov 30 07:28:08 user nova-compute[75293]: No targets found.
Nov 30 07:28:08 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:28:08 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:28:08 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd768c8-02b3-4d7f-9736-4148de9b88fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e153b1-06b1-459d-9d21-1fd64510f86f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:28:08 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:28:08 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:28:08 user nova-compute[75293]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)
Nov 30 07:28:08 user nova-compute[75293]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 (non-flash)
Nov 30 07:28:08 user nova-compute[75293]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:28:08 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:28:08 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:28:08 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:28:08 user nova-compute[75293]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)
Nov 30 07:28:08 user nova-compute[75293]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 (non-flash)
Nov 30 07:28:08 user nova-compute[75293]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:28:08 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe8077a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9'): ({'sdc'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Removing single pathed devices sdc {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6600ffb-410a-40d3-b0e3-c1ddc17dcd0d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[837cbc3b-522d-4d2f-97fc-b86480421f5c]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Flushing IO for device /dev/sdc {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1e2c9a-7080-452b-88a4-8feb6a17f770]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bbfc62-cf64-4010-8869-47a835abd21f]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] SCSI volumes sdc have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Updating instance_info_cache with network_info: [{"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-d89452ef-96ab-4081-bc40-0f64968de367" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.044s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[638a147f-b0bd-4632-9b5b-8652fae44559]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3527c3c4-3cbb-4565-9e53-9c2c012e7698]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9, portal: 172.16.0.220,3260]
Nov 30 07:28:08 user nova-compute[75293]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9, portal: 172.16.0.220,3260] successful.
Nov 30 07:28:08 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ed5e68f-d888-44d4-8cb4-8af1280073c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[214326e0-4721-49ac-9ed4-43e9f2718fea]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] <== disconnect_volume: return (361ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:28:08 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:28:09 user nova-compute[75293]: DEBUG nova.objects.instance [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lazy-loading 'flavor' on Instance uuid 2e215797-58b6-47bb-acbc-edd77e6cca2d {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:28:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-97df3b11-d160-434c-9ff1-48f3f682fb1f tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.820s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:28:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:15 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:28:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG nova.compute.manager [req-8ba52517-1e46-4471-bfb0-6d95d172dff6 req-9f4ef051-8698-4e9a-bac5-55d5aedbb66c service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Received event network-changed-f50eec80-6c1a-4e32-aea2-4f3058a65b01 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG nova.compute.manager [req-8ba52517-1e46-4471-bfb0-6d95d172dff6 req-9f4ef051-8698-4e9a-bac5-55d5aedbb66c service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Refreshing instance network info cache due to event network-changed-f50eec80-6c1a-4e32-aea2-4f3058a65b01. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8ba52517-1e46-4471-bfb0-6d95d172dff6 req-9f4ef051-8698-4e9a-bac5-55d5aedbb66c service nova] Acquiring lock "refresh_cache-df4d31a0-33c1-49e2-a446-99454c82199b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8ba52517-1e46-4471-bfb0-6d95d172dff6 req-9f4ef051-8698-4e9a-bac5-55d5aedbb66c service nova] Acquired lock "refresh_cache-df4d31a0-33c1-49e2-a446-99454c82199b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG nova.network.neutron [req-8ba52517-1e46-4471-bfb0-6d95d172dff6 req-9f4ef051-8698-4e9a-bac5-55d5aedbb66c service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Refreshing network info cache for port f50eec80-6c1a-4e32-aea2-4f3058a65b01 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG nova.network.neutron [req-8ba52517-1e46-4471-bfb0-6d95d172dff6 req-9f4ef051-8698-4e9a-bac5-55d5aedbb66c service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Updated VIF entry in instance network info cache for port f50eec80-6c1a-4e32-aea2-4f3058a65b01. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG nova.network.neutron [req-8ba52517-1e46-4471-bfb0-6d95d172dff6 req-9f4ef051-8698-4e9a-bac5-55d5aedbb66c service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Updating instance_info_cache with network_info: [{"id": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "address": "fa:16:3e:e9:a7:59", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50eec80-6c", "ovs_interfaceid": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8ba52517-1e46-4471-bfb0-6d95d172dff6 req-9f4ef051-8698-4e9a-bac5-55d5aedbb66c service nova] Releasing lock "refresh_cache-df4d31a0-33c1-49e2-a446-99454c82199b" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "df4d31a0-33c1-49e2-a446-99454c82199b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "df4d31a0-33c1-49e2-a446-99454c82199b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "df4d31a0-33c1-49e2-a446-99454c82199b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "df4d31a0-33c1-49e2-a446-99454c82199b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "df4d31a0-33c1-49e2-a446-99454c82199b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:28:31 user nova-compute[75293]: INFO nova.compute.manager [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Terminating instance
Nov 30 07:28:31 user nova-compute[75293]: DEBUG nova.compute.manager [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG nova.compute.manager [req-c5a055f7-fd97-4a0a-90e2-05fa00880bf3 req-31b6dd1c-f969-4d22-b350-312762c7135e service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Received event network-vif-unplugged-f50eec80-6c1a-4e32-aea2-4f3058a65b01 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c5a055f7-fd97-4a0a-90e2-05fa00880bf3 req-31b6dd1c-f969-4d22-b350-312762c7135e service nova] Acquiring lock "df4d31a0-33c1-49e2-a446-99454c82199b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c5a055f7-fd97-4a0a-90e2-05fa00880bf3 req-31b6dd1c-f969-4d22-b350-312762c7135e service nova] Lock "df4d31a0-33c1-49e2-a446-99454c82199b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c5a055f7-fd97-4a0a-90e2-05fa00880bf3 req-31b6dd1c-f969-4d22-b350-312762c7135e service nova] Lock "df4d31a0-33c1-49e2-a446-99454c82199b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG nova.compute.manager [req-c5a055f7-fd97-4a0a-90e2-05fa00880bf3 req-31b6dd1c-f969-4d22-b350-312762c7135e service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] No waiting events found dispatching network-vif-unplugged-f50eec80-6c1a-4e32-aea2-4f3058a65b01 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG nova.compute.manager [req-c5a055f7-fd97-4a0a-90e2-05fa00880bf3 req-31b6dd1c-f969-4d22-b350-312762c7135e service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Received event network-vif-unplugged-f50eec80-6c1a-4e32-aea2-4f3058a65b01 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:32 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Instance destroyed successfully.
Nov 30 07:28:32 user nova-compute[75293]: DEBUG nova.objects.instance [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lazy-loading 'resources' on Instance uuid df4d31a0-33c1-49e2-a446-99454c82199b {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1418291978',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1418291978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1418291978',id=42,image_ref='4c4d5218-816b-423c-ba49-74bf86acb793',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZAyUybRyGIPSTkmWgT4OlypzVdNz6Byu6rMOK9BDsQrVsTWWDZdokkkTMV0KQGvzJ+2mLl8QtmdtSkXTmA9QhoAdQwA+rtdOWj3XEv2zzTWUIwxbX/LZiZsdMZ1vjCYw==',key_name='tempest-keypair-722633649',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:26:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4bfa84ea3874ba7ac0af4c3b1d2f918',ramdisk_id='',reservation_id='r-v2jlp74w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-273596612',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-273596612-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-273596612',owner_user_name='tempest-TestVolumeBootPattern-273596612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:27:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbee62d1b15144cc9d433a4a64dd12a7',uuid=df4d31a0-33c1-49e2-a446-99454c82199b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "address": "fa:16:3e:e9:a7:59", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50eec80-6c", "ovs_interfaceid": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converting VIF {"id": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "address": "fa:16:3e:e9:a7:59", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50eec80-6c", "ovs_interfaceid": "f50eec80-6c1a-4e32-aea2-4f3058a65b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:a7:59,bridge_name='br-int',has_traffic_filtering=True,id=f50eec80-6c1a-4e32-aea2-4f3058a65b01,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf50eec80-6c') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_vif [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:a7:59,bridge_name='br-int',has_traffic_filtering=True,id=f50eec80-6c1a-4e32-aea2-4f3058a65b01,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf50eec80-6c') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf50eec80-6c, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=787e3e8c-6dc3-4046-bf43-c0ba6563eea7) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:32 user nova-compute[75293]: INFO os_vif [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:a7:59,bridge_name='br-int',has_traffic_filtering=True,id=f50eec80-6c1a-4e32-aea2-4f3058a65b01,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf50eec80-6c')
Nov 30 07:28:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOEPZdrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:28:32 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a793b4-d12a-4765-9986-cf38f01efa89]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:28:32 user nova-compute[75293]: No targets found.
Nov 30 07:28:32 user nova-compute[75293]: iSNS:
Nov 30 07:28:32 user nova-compute[75293]: No targets found.
Nov 30 07:28:32 user nova-compute[75293]: STATIC:
Nov 30 07:28:32 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0
Nov 30 07:28:32 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:28:32 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:28:32 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:28:32 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:28:32 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:28:32 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea
Nov 30 07:28:32 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:28:32 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:28:32 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c
Nov 30 07:28:32 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:28:32 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:28:32 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf
Nov 30 07:28:32 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:28:32 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:28:32 user nova-compute[75293]: FIRMWARE:
Nov 30 07:28:32 user nova-compute[75293]: No targets found.
Nov 30 07:28:32 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:28:32 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:28:32 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b9b171-5a24-4d63-8b76-f01eac8371c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db9822b-ba20-4add-9df5-b86e6e56a6ff]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:28:32 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:28:32 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:28:32 user nova-compute[75293]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)
Nov 30 07:28:32 user nova-compute[75293]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:28:32 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:28:32 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:28:32 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:28:32 user nova-compute[75293]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 (non-flash)
Nov 30 07:28:32 user nova-compute[75293]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:28:32 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe0362050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0'): ({'sdf'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Removing single pathed devices sdf {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae4c8bd-5a3f-4873-b3ad-26ff08a47712]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e26c8a-a85b-4326-a3ff-4c9b286ae6d2]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Flushing IO for device /dev/sdf {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3070c11e-66b3-4633-9fbb-06f3030517b9]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[904bbf53-1ec6-4d70-849b-5ebf49c3019e]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] SCSI volumes sdf have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1df94dac-8559c249e1121046', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1df94dac', '/dev/disk/by-id/scsi-23835353963323439') {{(pid=86417) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 07:28:32 user nova-compute[75293]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO1df94dac-8559c249e1121046
Nov 30 07:28:32 user nova-compute[75293]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_1df94dac
Nov 30 07:28:32 user nova-compute[75293]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23835353963323439
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[901127fb-ebc6-46fb-9553-f6ec0dc13189]: (4, None) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4077c1-775a-452e-b7d0-e6613e85be45]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57199f6-bc53-4ca8-b632-79e09bac7539]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0, portal: 172.16.0.220,3260]
Nov 30 07:28:32 user nova-compute[75293]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0, portal: 172.16.0.220,3260] successful.
Nov 30 07:28:32 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7436318-e6d4-409b-bc9f-ea0c62154fc0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74141ae-eb14-4ede-9775-e23292b58b7f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] <== disconnect_volume: return (334ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:28:32 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Deleting instance files /opt/stack/data/nova/instances/df4d31a0-33c1-49e2-a446-99454c82199b_del
Nov 30 07:28:32 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Deletion of /opt/stack/data/nova/instances/df4d31a0-33c1-49e2-a446-99454c82199b_del complete
Nov 30 07:28:32 user nova-compute[75293]: INFO nova.compute.manager [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 30 07:28:32 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:28:32 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:28:33 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:28:33 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Took 0.60 seconds to deallocate network for instance.
Nov 30 07:28:33 user nova-compute[75293]: DEBUG nova.compute.manager [req-45fd82aa-7e3c-4a5d-b06a-fbfc472253cd req-ed809c2d-db6f-48b6-912c-fe9ec75eb199 service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Received event network-vif-deleted-f50eec80-6c1a-4e32-aea2-4f3058a65b01 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:28:33 user nova-compute[75293]: INFO nova.compute.manager [req-45fd82aa-7e3c-4a5d-b06a-fbfc472253cd req-ed809c2d-db6f-48b6-912c-fe9ec75eb199 service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Neutron deleted interface f50eec80-6c1a-4e32-aea2-4f3058a65b01; detaching it from the instance and deleting it from the info cache
Nov 30 07:28:33 user nova-compute[75293]: DEBUG nova.network.neutron [req-45fd82aa-7e3c-4a5d-b06a-fbfc472253cd req-ed809c2d-db6f-48b6-912c-fe9ec75eb199 service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:28:33 user nova-compute[75293]: DEBUG nova.compute.manager [req-45fd82aa-7e3c-4a5d-b06a-fbfc472253cd req-ed809c2d-db6f-48b6-912c-fe9ec75eb199 service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Detach interface failed, port_id=f50eec80-6c1a-4e32-aea2-4f3058a65b01, reason: Instance df4d31a0-33c1-49e2-a446-99454c82199b could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:28:33 user nova-compute[75293]: DEBUG nova.compute.manager [req-567094a3-b9e3-46db-8626-193f68cdb5b4 req-d5b3a70a-3fe8-4634-b35d-cb305b604f09 service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Received event network-vif-plugged-f50eec80-6c1a-4e32-aea2-4f3058a65b01 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:28:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-567094a3-b9e3-46db-8626-193f68cdb5b4 req-d5b3a70a-3fe8-4634-b35d-cb305b604f09 service nova] Acquiring lock "df4d31a0-33c1-49e2-a446-99454c82199b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:28:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-567094a3-b9e3-46db-8626-193f68cdb5b4 req-d5b3a70a-3fe8-4634-b35d-cb305b604f09 service nova] Lock "df4d31a0-33c1-49e2-a446-99454c82199b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:28:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-567094a3-b9e3-46db-8626-193f68cdb5b4 req-d5b3a70a-3fe8-4634-b35d-cb305b604f09 service nova] Lock "df4d31a0-33c1-49e2-a446-99454c82199b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:28:33 user nova-compute[75293]: DEBUG nova.compute.manager [req-567094a3-b9e3-46db-8626-193f68cdb5b4 req-d5b3a70a-3fe8-4634-b35d-cb305b604f09 service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] No waiting events found dispatching network-vif-plugged-f50eec80-6c1a-4e32-aea2-4f3058a65b01 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:28:33 user nova-compute[75293]: WARNING nova.compute.manager [req-567094a3-b9e3-46db-8626-193f68cdb5b4 req-d5b3a70a-3fe8-4634-b35d-cb305b604f09 service nova] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Received unexpected event network-vif-plugged-f50eec80-6c1a-4e32-aea2-4f3058a65b01 for instance with vm_state active and task_state deleting.
Nov 30 07:28:33 user nova-compute[75293]: INFO nova.compute.manager [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Took 0.75 seconds to detach 1 volumes for instance.
Nov 30 07:28:33 user nova-compute[75293]: DEBUG nova.compute.manager [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: df4d31a0-33c1-49e2-a446-99454c82199b] Deleting volume: e7436318-e6d4-409b-bc9f-ea0c62154fc0 {{(pid=75293) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 07:28:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:28:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:28:34 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:28:34 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:28:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:28:34 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Deleted allocations for instance df4d31a0-33c1-49e2-a446-99454c82199b
Nov 30 07:28:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-9f606f3a-787e-4f61-83fa-7f08c8dadc17 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "df4d31a0-33c1-49e2-a446-99454c82199b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.817s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:28:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "2e215797-58b6-47bb-acbc-edd77e6cca2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:28:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:28:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "2e215797-58b6-47bb-acbc-edd77e6cca2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:28:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:28:37 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:28:37 user nova-compute[75293]: INFO nova.compute.manager [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Terminating instance
Nov 30 07:28:37 user nova-compute[75293]: DEBUG nova.compute.manager [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:28:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:38 user nova-compute[75293]: DEBUG nova.compute.manager [req-327bde35-e196-45f4-94de-2f7405313791 req-db46bf3a-d375-429b-bdba-780494f55fdb service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Received event network-vif-unplugged-9ff82ba5-78d7-420b-b9b3-b045ed2dcefd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:28:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-327bde35-e196-45f4-94de-2f7405313791 req-db46bf3a-d375-429b-bdba-780494f55fdb service nova] Acquiring lock "2e215797-58b6-47bb-acbc-edd77e6cca2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:28:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-327bde35-e196-45f4-94de-2f7405313791 req-db46bf3a-d375-429b-bdba-780494f55fdb service nova] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:28:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-327bde35-e196-45f4-94de-2f7405313791 req-db46bf3a-d375-429b-bdba-780494f55fdb service nova] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:28:38 user nova-compute[75293]: DEBUG nova.compute.manager [req-327bde35-e196-45f4-94de-2f7405313791 req-db46bf3a-d375-429b-bdba-780494f55fdb service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] No waiting events found dispatching network-vif-unplugged-9ff82ba5-78d7-420b-b9b3-b045ed2dcefd {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:28:38 user nova-compute[75293]: DEBUG nova.compute.manager [req-327bde35-e196-45f4-94de-2f7405313791 req-db46bf3a-d375-429b-bdba-780494f55fdb service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Received event network-vif-unplugged-9ff82ba5-78d7-420b-b9b3-b045ed2dcefd for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:28:38 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Instance destroyed successfully.
Nov 30 07:28:38 user nova-compute[75293]: DEBUG nova.objects.instance [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lazy-loading 'resources' on Instance uuid 2e215797-58b6-47bb-acbc-edd77e6cca2d {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:28:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-554807482',display_name='tempest-AttachVolumeNegativeTest-server-554807482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-554807482',id=41,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0+bavRR221GVEQCkkD461W5sIzD+nROEEDkS8aS8Bs0wX9A3tA7ljoZF416OTrr9/Tv1weM71H/rcAeOpv+L4otgmteVAxvZlPsnhoEUZgeCIbacARUJi5CzquMJ133A==',key_name='tempest-keypair-1952980149',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68ff34b2e2c047319c1fe166c5029790',ramdisk_id='',reservation_id='r-tmet18bu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1915468397',owner_user_name='tempest-AttachVolumeNegativeTest-1915468397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:25:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe34a1b2c38472d831ae5d7afa85c77',uuid=2e215797-58b6-47bb-acbc-edd77e6cca2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "address": "fa:16:3e:e6:ca:88", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff82ba5-78", "ovs_interfaceid": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:28:38 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converting VIF {"id": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "address": "fa:16:3e:e6:ca:88", "network": {"id": "900762bc-c257-480d-926e-4d3e939e9d45", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333874619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ff34b2e2c047319c1fe166c5029790", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ff82ba5-78", "ovs_interfaceid": "9ff82ba5-78d7-420b-b9b3-b045ed2dcefd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:28:38 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:ca:88,bridge_name='br-int',has_traffic_filtering=True,id=9ff82ba5-78d7-420b-b9b3-b045ed2dcefd,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff82ba5-78') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:28:38 user nova-compute[75293]: DEBUG os_vif [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:ca:88,bridge_name='br-int',has_traffic_filtering=True,id=9ff82ba5-78d7-420b-b9b3-b045ed2dcefd,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff82ba5-78') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:28:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ff82ba5-78, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:28:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:28:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87fb6f1b-2a31-4751-9681-62886b6ff7a4) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:28:38 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:28:38 user nova-compute[75293]: INFO os_vif [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:ca:88,bridge_name='br-int',has_traffic_filtering=True,id=9ff82ba5-78d7-420b-b9b3-b045ed2dcefd,network=Network(900762bc-c257-480d-926e-4d3e939e9d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ff82ba5-78')
Nov 30 07:28:38 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Deleting instance files /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d_del
Nov 30 07:28:38 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Deletion of /opt/stack/data/nova/instances/2e215797-58b6-47bb-acbc-edd77e6cca2d_del complete
Nov 30 07:28:38 user nova-compute[75293]: INFO nova.compute.manager [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 30 07:28:38 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:28:38 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:28:38 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:28:39 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:28:39 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Took 0.70 seconds to deallocate network for instance.
Nov 30 07:28:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:28:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:28:39 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:28:39 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:28:39 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:28:39 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Deleted allocations for instance 2e215797-58b6-47bb-acbc-edd77e6cca2d
Nov 30 07:28:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-fd947a3c-ac4d-4a03-8b13-7b49707ee474 tempest-AttachVolumeNegativeTest-1915468397 tempest-AttachVolumeNegativeTest-1915468397-project-member] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.220s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:28:40 user nova-compute[75293]: DEBUG nova.compute.manager [req-2d7cbafa-f586-4fee-a32e-105b520ab450 req-aefabb27-d700-465f-917e-12017364220e service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Received event network-vif-plugged-9ff82ba5-78d7-420b-b9b3-b045ed2dcefd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:28:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2d7cbafa-f586-4fee-a32e-105b520ab450 req-aefabb27-d700-465f-917e-12017364220e service nova] Acquiring lock "2e215797-58b6-47bb-acbc-edd77e6cca2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:28:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2d7cbafa-f586-4fee-a32e-105b520ab450 req-aefabb27-d700-465f-917e-12017364220e service nova] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:28:40 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-2d7cbafa-f586-4fee-a32e-105b520ab450 req-aefabb27-d700-465f-917e-12017364220e service nova] Lock "2e215797-58b6-47bb-acbc-edd77e6cca2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:28:40 user nova-compute[75293]: DEBUG nova.compute.manager [req-2d7cbafa-f586-4fee-a32e-105b520ab450 req-aefabb27-d700-465f-917e-12017364220e service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] No waiting events found dispatching network-vif-plugged-9ff82ba5-78d7-420b-b9b3-b045ed2dcefd {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:28:40 user nova-compute[75293]: WARNING nova.compute.manager [req-2d7cbafa-f586-4fee-a32e-105b520ab450 req-aefabb27-d700-465f-917e-12017364220e service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Received unexpected event network-vif-plugged-9ff82ba5-78d7-420b-b9b3-b045ed2dcefd for instance with vm_state deleted and task_state None.
Nov 30 07:28:40 user nova-compute[75293]: DEBUG nova.compute.manager [req-2d7cbafa-f586-4fee-a32e-105b520ab450 req-aefabb27-d700-465f-917e-12017364220e service nova] [instance: 2e215797-58b6-47bb-acbc-edd77e6cca2d] Received event network-vif-deleted-9ff82ba5-78d7-420b-b9b3-b045ed2dcefd {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:28:43 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:28:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75293) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 07:28:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:28:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:28:48 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:28:53 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:28:58 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:28:58 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:28:58 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:29:00 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:29:03 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:29:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:29:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:29:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:29:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:29:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:29:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:29:04 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:29:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:29:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:29:05 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:29:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:29:06 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:29:06 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:29:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=8420MB free_disk=24.907684326171875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:29:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:29:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:29:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance c8d1df78-2aa2-4710-a570-5f72c60cfc26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:29:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:29:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 54c60b45-04dc-4d3b-96ec-c2d0f583cafa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:29:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance e67ad73a-2c4b-4cfe-acc5-e62d95d09318 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:29:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 11e67339-be9e-481a-a8d2-8573caa97866 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:29:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance d89452ef-96ab-4081-bc40-0f64968de367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:29:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:29:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:29:06 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:29:06 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:29:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:29:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.350s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:29:07 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:29:07 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:29:07 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:29:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-e67ad73a-2c4b-4cfe-acc5-e62d95d09318" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:29:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-e67ad73a-2c4b-4cfe-acc5-e62d95d09318" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:29:07 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:29:08 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Updating instance_info_cache with network_info: [{"id": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "address": "fa:16:3e:80:e5:cd", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce63f6a4-44", "ovs_interfaceid": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:29:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-e67ad73a-2c4b-4cfe-acc5-e62d95d09318" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:29:08 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:29:08 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:29:08 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:29:08 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:29:11 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:29:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:29:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:29:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "11e67339-be9e-481a-a8d2-8573caa97866" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:29:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "11e67339-be9e-481a-a8d2-8573caa97866" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:29:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "11e67339-be9e-481a-a8d2-8573caa97866-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:29:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "11e67339-be9e-481a-a8d2-8573caa97866-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:29:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "11e67339-be9e-481a-a8d2-8573caa97866-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:29:26 user nova-compute[75293]: INFO nova.compute.manager [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Terminating instance
Nov 30 07:29:26 user nova-compute[75293]: DEBUG nova.compute.manager [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:29:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-dfa1cc43-f685-48a8-9c2e-1f8425655c61 req-976353d2-70ed-4f73-bbe9-50dd0159a935 service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Received event network-vif-unplugged-1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:29:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-dfa1cc43-f685-48a8-9c2e-1f8425655c61 req-976353d2-70ed-4f73-bbe9-50dd0159a935 service nova] Acquiring lock "11e67339-be9e-481a-a8d2-8573caa97866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:29:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-dfa1cc43-f685-48a8-9c2e-1f8425655c61 req-976353d2-70ed-4f73-bbe9-50dd0159a935 service nova] Lock "11e67339-be9e-481a-a8d2-8573caa97866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:29:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-dfa1cc43-f685-48a8-9c2e-1f8425655c61 req-976353d2-70ed-4f73-bbe9-50dd0159a935 service nova] Lock "11e67339-be9e-481a-a8d2-8573caa97866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:29:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-dfa1cc43-f685-48a8-9c2e-1f8425655c61 req-976353d2-70ed-4f73-bbe9-50dd0159a935 service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] No waiting events found dispatching network-vif-unplugged-1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:29:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-dfa1cc43-f685-48a8-9c2e-1f8425655c61 req-976353d2-70ed-4f73-bbe9-50dd0159a935 service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Received event network-vif-unplugged-1582c6d0-9518-41fa-907e-7c64af37731b for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:27 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Instance destroyed successfully.
Nov 30 07:29:27 user nova-compute[75293]: DEBUG nova.objects.instance [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lazy-loading 'resources' on Instance uuid 11e67339-be9e-481a-a8d2-8573caa97866 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:24:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-499440655',display_name='tempest-TestVolumeBootPattern-volume-backed-server-499440655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-499440655',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdxGSQCpq3eCaS2wDTlAbV+wJ9939OUTl3NOz3PUxrF4CalT3ANXoFQsRDiODkeO9GbfLkFc34D1JdUPV8OkpoMwrFrJDSOmkN7hppO+y12ijmnZUQwUt/pUxvXod9M1A==',key_name='tempest-keypair-44416766',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:24:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4bfa84ea3874ba7ac0af4c3b1d2f918',ramdisk_id='',reservation_id='r-ymzgl0l3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-273596612',owner_user_name='tempest-TestVolumeBootPattern-273596612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:24:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbee62d1b15144cc9d433a4a64dd12a7',uuid=11e67339-be9e-481a-a8d2-8573caa97866,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1582c6d0-9518-41fa-907e-7c64af37731b", "address": "fa:16:3e:88:c5:08", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1582c6d0-95", "ovs_interfaceid": "1582c6d0-9518-41fa-907e-7c64af37731b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converting VIF {"id": "1582c6d0-9518-41fa-907e-7c64af37731b", "address": "fa:16:3e:88:c5:08", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1582c6d0-95", "ovs_interfaceid": "1582c6d0-9518-41fa-907e-7c64af37731b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:c5:08,bridge_name='br-int',has_traffic_filtering=True,id=1582c6d0-9518-41fa-907e-7c64af37731b,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1582c6d0-95') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_vif [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:c5:08,bridge_name='br-int',has_traffic_filtering=True,id=1582c6d0-9518-41fa-907e-7c64af37731b,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1582c6d0-95') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1582c6d0-95, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a500ce02-9c4d-4d95-99db-c8c80a994b8b) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:29:27 user nova-compute[75293]: INFO os_vif [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:c5:08,bridge_name='br-int',has_traffic_filtering=True,id=1582c6d0-9518-41fa-907e-7c64af37731b,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1582c6d0-95')
Nov 30 07:29:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBSwTVJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:29:27 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ac0315-0645-488c-b163-e3a070f17d2e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:29:27 user nova-compute[75293]: No targets found.
Nov 30 07:29:27 user nova-compute[75293]: iSNS:
Nov 30 07:29:27 user nova-compute[75293]: No targets found.
Nov 30 07:29:27 user nova-compute[75293]: STATIC:
Nov 30 07:29:27 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:29:27 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:29:27 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:29:27 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea
Nov 30 07:29:27 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:29:27 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:29:27 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c
Nov 30 07:29:27 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:29:27 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:29:27 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf
Nov 30 07:29:27 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:29:27 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:29:27 user nova-compute[75293]: FIRMWARE:
Nov 30 07:29:27 user nova-compute[75293]: No targets found.
Nov 30 07:29:27 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:29:27 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:29:27 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca7cd9e-9dc4-492e-b299-ee190e9f4a77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca70546-ab19-4987-94a7-3cad05abc793]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:29:27 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:29:27 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:29:27 user nova-compute[75293]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:29:27 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:29:27 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:29:27 user nova-compute[75293]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c (non-flash)
Nov 30 07:29:27 user nova-compute[75293]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:29:27 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effc87e6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c'): ({'sde'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Removing single pathed devices sde {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2bc878-1bb7-4bb4-bb4e-5086471003c3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbff735-e4f4-4fab-81bc-36094bb7df83]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Flushing IO for device /dev/sde {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4877ce58-1b17-4f33-a28b-ca691399474c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c820f47-93a2-4b79-9fea-bc0eaa117ad2]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] SCSI volumes sde have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26135356230316532', '/dev/disk/by-id/scsi-1SCST_BIOd6320826-a55b01e28cd0ce2d', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d6320826') {{(pid=86417) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c49955a-faf4-4738-98d3-6862778d2ec4]: (4, None) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f42f305-c540-42ea-9f10-7494e133a4b2]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[759eae93-07f1-4e7e-8be1-32eed5f86ede]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c, portal: 172.16.0.220,3260]
Nov 30 07:29:27 user nova-compute[75293]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c, portal: 172.16.0.220,3260] successful.
Nov 30 07:29:27 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09a17d0-b9a1-48df-a557-3114c31f831c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b323abde-e320-42eb-b804-fa6e65ce4f80]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] <== disconnect_volume: return (361ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:29:27 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Deleting instance files /opt/stack/data/nova/instances/11e67339-be9e-481a-a8d2-8573caa97866_del
Nov 30 07:29:27 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Deletion of /opt/stack/data/nova/instances/11e67339-be9e-481a-a8d2-8573caa97866_del complete
Nov 30 07:29:27 user nova-compute[75293]: INFO nova.compute.manager [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 30 07:29:27 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:28 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:29:28 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Took 0.66 seconds to deallocate network for instance.
Nov 30 07:29:28 user nova-compute[75293]: DEBUG nova.compute.manager [req-a55d17f7-93e6-4524-a0f5-85c898d4816e req-ab2935a2-9679-42c0-b199-8382ca7a5f14 service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Received event network-vif-deleted-1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Received event network-vif-plugged-1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] Acquiring lock "11e67339-be9e-481a-a8d2-8573caa97866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] Lock "11e67339-be9e-481a-a8d2-8573caa97866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] Lock "11e67339-be9e-481a-a8d2-8573caa97866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] No waiting events found dispatching network-vif-plugged-1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:29:29 user nova-compute[75293]: WARNING nova.compute.manager [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Received unexpected event network-vif-plugged-1582c6d0-9518-41fa-907e-7c64af37731b for instance with vm_state active and task_state deleting.
Nov 30 07:29:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Received event network-vif-plugged-1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] Acquiring lock "11e67339-be9e-481a-a8d2-8573caa97866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] Lock "11e67339-be9e-481a-a8d2-8573caa97866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] Lock "11e67339-be9e-481a-a8d2-8573caa97866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] No waiting events found dispatching network-vif-plugged-1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:29:29 user nova-compute[75293]: WARNING nova.compute.manager [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Received unexpected event network-vif-plugged-1582c6d0-9518-41fa-907e-7c64af37731b for instance with vm_state active and task_state deleting.
Nov 30 07:29:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Received event network-vif-plugged-1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] Acquiring lock "11e67339-be9e-481a-a8d2-8573caa97866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] Lock "11e67339-be9e-481a-a8d2-8573caa97866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] Lock "11e67339-be9e-481a-a8d2-8573caa97866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] No waiting events found dispatching network-vif-plugged-1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:29:29 user nova-compute[75293]: WARNING nova.compute.manager [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Received unexpected event network-vif-plugged-1582c6d0-9518-41fa-907e-7c64af37731b for instance with vm_state active and task_state deleting.
Nov 30 07:29:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Received event network-vif-unplugged-1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] Acquiring lock "11e67339-be9e-481a-a8d2-8573caa97866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] Lock "11e67339-be9e-481a-a8d2-8573caa97866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] Lock "11e67339-be9e-481a-a8d2-8573caa97866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] No waiting events found dispatching network-vif-unplugged-1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Received event network-vif-unplugged-1582c6d0-9518-41fa-907e-7c64af37731b for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Received event network-vif-plugged-1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] Acquiring lock "11e67339-be9e-481a-a8d2-8573caa97866-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] Lock "11e67339-be9e-481a-a8d2-8573caa97866-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] Lock "11e67339-be9e-481a-a8d2-8573caa97866-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] No waiting events found dispatching network-vif-plugged-1582c6d0-9518-41fa-907e-7c64af37731b {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:29:29 user nova-compute[75293]: WARNING nova.compute.manager [req-311dc32a-12d7-4c09-84eb-21111461495f req-224fa28e-bfb5-49ec-b640-f229f53d47da service nova] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Received unexpected event network-vif-plugged-1582c6d0-9518-41fa-907e-7c64af37731b for instance with vm_state active and task_state deleting.
Nov 30 07:29:29 user nova-compute[75293]: INFO nova.compute.manager [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Took 1.01 seconds to detach 1 volumes for instance.
Nov 30 07:29:29 user nova-compute[75293]: DEBUG nova.compute.manager [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 11e67339-be9e-481a-a8d2-8573caa97866] Deleting volume: b09a17d0-b9a1-48df-a557-3114c31f831c {{(pid=75293) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:29:29 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:29:30 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:29:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:29:30 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Deleted allocations for instance 11e67339-be9e-481a-a8d2-8573caa97866
Nov 30 07:29:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0ded34e7-1596-45b4-afb1-252e28feb4f0 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "11e67339-be9e-481a-a8d2-8573caa97866" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.762s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:29:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:29:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:29:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:29:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:29:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:29:33 user nova-compute[75293]: INFO nova.compute.manager [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Terminating instance
Nov 30 07:29:33 user nova-compute[75293]: DEBUG nova.compute.manager [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:29:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:33 user nova-compute[75293]: DEBUG nova.compute.manager [req-095f78fc-9e2c-4fa0-8c56-abe05ba905a6 req-5a5777a4-e2e5-4836-ab94-3aae2f7a0764 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received event network-vif-unplugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:29:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-095f78fc-9e2c-4fa0-8c56-abe05ba905a6 req-5a5777a4-e2e5-4836-ab94-3aae2f7a0764 service nova] Acquiring lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:29:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-095f78fc-9e2c-4fa0-8c56-abe05ba905a6 req-5a5777a4-e2e5-4836-ab94-3aae2f7a0764 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:29:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-095f78fc-9e2c-4fa0-8c56-abe05ba905a6 req-5a5777a4-e2e5-4836-ab94-3aae2f7a0764 service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:29:33 user nova-compute[75293]: DEBUG nova.compute.manager [req-095f78fc-9e2c-4fa0-8c56-abe05ba905a6 req-5a5777a4-e2e5-4836-ab94-3aae2f7a0764 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] No waiting events found dispatching network-vif-unplugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:29:33 user nova-compute[75293]: DEBUG nova.compute.manager [req-095f78fc-9e2c-4fa0-8c56-abe05ba905a6 req-5a5777a4-e2e5-4836-ab94-3aae2f7a0764 service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received event network-vif-unplugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:29:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:33 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:34 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Instance destroyed successfully.
Nov 30 07:29:34 user nova-compute[75293]: DEBUG nova.objects.instance [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'resources' on Instance uuid e67ad73a-2c4b-4cfe-acc5-e62d95d09318 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:24:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2032492824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2032492824',id=38,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:26:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f09e4044dadb4f2aa0d29f35f23008d2',ramdisk_id='',reservation_id='r-4p00a3zd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:27:47Z,user_data=None,user_id='83119c1bbe4142a086680a113403018c',uuid=e67ad73a-2c4b-4cfe-acc5-e62d95d09318,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "address": "fa:16:3e:80:e5:cd", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce63f6a4-44", "ovs_interfaceid": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converting VIF {"id": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "address": "fa:16:3e:80:e5:cd", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce63f6a4-44", "ovs_interfaceid": "ce63f6a4-4402-477b-9c67-d63143bfa7c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:e5:cd,bridge_name='br-int',has_traffic_filtering=True,id=ce63f6a4-4402-477b-9c67-d63143bfa7c9,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce63f6a4-44') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_vif [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:e5:cd,bridge_name='br-int',has_traffic_filtering=True,id=ce63f6a4-4402-477b-9c67-d63143bfa7c9,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce63f6a4-44') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce63f6a4-44, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=771c5e30-ea95-4dc3-b41c-6d6cd229182e) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:34 user nova-compute[75293]: INFO os_vif [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:e5:cd,bridge_name='br-int',has_traffic_filtering=True,id=ce63f6a4-4402-477b-9c67-d63143bfa7c9,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce63f6a4-44')
Nov 30 07:29:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoZTybOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:29:34 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[17774fa0-b112-4023-849f-a23fef209321]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:29:34 user nova-compute[75293]: No targets found.
Nov 30 07:29:34 user nova-compute[75293]: iSNS:
Nov 30 07:29:34 user nova-compute[75293]: No targets found.
Nov 30 07:29:34 user nova-compute[75293]: STATIC:
Nov 30 07:29:34 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:29:34 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:29:34 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:29:34 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea
Nov 30 07:29:34 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:29:34 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:29:34 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf
Nov 30 07:29:34 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:29:34 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:29:34 user nova-compute[75293]: FIRMWARE:
Nov 30 07:29:34 user nova-compute[75293]: No targets found.
Nov 30 07:29:34 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:29:34 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:29:34 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a1ca07-742d-4966-9d05-2841b3f65143]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ddbef7-0152-41dc-bd24-7223ad417e1f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:29:34 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:29:34 user nova-compute[75293]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:29:34 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:29:34 user nova-compute[75293]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea (non-flash)
Nov 30 07:29:34 user nova-compute[75293]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:29:34 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effc846f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea'): ({'sdb'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Removing single pathed devices sdb {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ddb3f8-7977-4934-90e0-f860525e10f4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c027b8b-3691-4eb1-ba40-4da54e172c89]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Flushing IO for device /dev/sdb {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[639c2867-de4b-4138-a331-80b7ff70c272]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b95f4f-e9da-4cff-89fe-6a99e99d656c]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db5261e-6211-409c-bcad-f893ed4b0472]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea95bd97-4c8e-4de3-9e79-ac2f34bf997d]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea, portal: 172.16.0.220,3260]
Nov 30 07:29:34 user nova-compute[75293]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea, portal: 172.16.0.220,3260] successful.
Nov 30 07:29:34 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2be752a-991a-4d8e-95a4-0e8570f54cea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bf74d7-9745-4389-abcc-1467bba4fedb]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] <== disconnect_volume: return (313ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:29:34 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Deleting instance files /opt/stack/data/nova/instances/e67ad73a-2c4b-4cfe-acc5-e62d95d09318_del
Nov 30 07:29:34 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Deletion of /opt/stack/data/nova/instances/e67ad73a-2c4b-4cfe-acc5-e62d95d09318_del complete
Nov 30 07:29:34 user nova-compute[75293]: INFO nova.compute.manager [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 30 07:29:34 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:29:34 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:29:35 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:29:35 user nova-compute[75293]: DEBUG nova.compute.manager [req-bd5a7f37-5e95-45c0-bec3-4533483e3043 req-f20312ac-024c-4c3c-ab22-f3d0e11a692c service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received event network-vif-deleted-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:29:35 user nova-compute[75293]: INFO nova.compute.manager [req-bd5a7f37-5e95-45c0-bec3-4533483e3043 req-f20312ac-024c-4c3c-ab22-f3d0e11a692c service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Neutron deleted interface ce63f6a4-4402-477b-9c67-d63143bfa7c9; detaching it from the instance and deleting it from the info cache
Nov 30 07:29:35 user nova-compute[75293]: DEBUG nova.network.neutron [req-bd5a7f37-5e95-45c0-bec3-4533483e3043 req-f20312ac-024c-4c3c-ab22-f3d0e11a692c service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:29:35 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Took 0.44 seconds to deallocate network for instance.
Nov 30 07:29:35 user nova-compute[75293]: DEBUG nova.compute.manager [req-bd5a7f37-5e95-45c0-bec3-4533483e3043 req-f20312ac-024c-4c3c-ab22-f3d0e11a692c service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Detach interface failed, port_id=ce63f6a4-4402-477b-9c67-d63143bfa7c9, reason: Instance e67ad73a-2c4b-4cfe-acc5-e62d95d09318 could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:29:35 user nova-compute[75293]: DEBUG nova.compute.manager [req-8cbbd1ee-a704-4c87-80eb-40b0cd3a1dda req-78e3cba8-a8d2-4bf8-acbd-a96625d9cccf service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:29:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8cbbd1ee-a704-4c87-80eb-40b0cd3a1dda req-78e3cba8-a8d2-4bf8-acbd-a96625d9cccf service nova] Acquiring lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:29:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8cbbd1ee-a704-4c87-80eb-40b0cd3a1dda req-78e3cba8-a8d2-4bf8-acbd-a96625d9cccf service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:29:35 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8cbbd1ee-a704-4c87-80eb-40b0cd3a1dda req-78e3cba8-a8d2-4bf8-acbd-a96625d9cccf service nova] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:29:35 user nova-compute[75293]: DEBUG nova.compute.manager [req-8cbbd1ee-a704-4c87-80eb-40b0cd3a1dda req-78e3cba8-a8d2-4bf8-acbd-a96625d9cccf service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] No waiting events found dispatching network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:29:35 user nova-compute[75293]: WARNING nova.compute.manager [req-8cbbd1ee-a704-4c87-80eb-40b0cd3a1dda req-78e3cba8-a8d2-4bf8-acbd-a96625d9cccf service nova] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Received unexpected event network-vif-plugged-ce63f6a4-4402-477b-9c67-d63143bfa7c9 for instance with vm_state active and task_state deleting.
Nov 30 07:29:35 user nova-compute[75293]: INFO nova.compute.manager [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: e67ad73a-2c4b-4cfe-acc5-e62d95d09318] Took 0.76 seconds to detach 1 volumes for instance.
Nov 30 07:29:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:29:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:29:36 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:29:36 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:29:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:29:36 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Deleted allocations for instance e67ad73a-2c4b-4cfe-acc5-e62d95d09318
Nov 30 07:29:36 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-682b9aaf-aeb9-4177-9c5c-6c4151f38ebc tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "e67ad73a-2c4b-4cfe-acc5-e62d95d09318" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.738s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:29:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:29:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:29:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:30:00 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:30:00 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:30:00 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:30:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:30:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75293) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 07:30:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:30:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:30:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:30:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:04 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:04 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:30:04 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:30:04 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:05 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:30:06 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:30:06 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:30:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=8696MB free_disk=24.905029296875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:30:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance c8d1df78-2aa2-4710-a570-5f72c60cfc26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:30:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:30:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 54c60b45-04dc-4d3b-96ec-c2d0f583cafa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:30:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance d89452ef-96ab-4081-bc40-0f64968de367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:30:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:30:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:30:06 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:30:06 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:30:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:30:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:07 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:30:07 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:30:07 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:30:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:30:09 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:30:09 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:30:09 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Didn't find any instances for network info cache update. {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 07:30:09 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:30:10 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:30:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:30:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75293) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 07:30:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:30:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:30:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:19 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "d89452ef-96ab-4081-bc40-0f64968de367" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "d89452ef-96ab-4081-bc40-0f64968de367" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "d89452ef-96ab-4081-bc40-0f64968de367-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:20 user nova-compute[75293]: INFO nova.compute.manager [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Terminating instance
Nov 30 07:30:20 user nova-compute[75293]: DEBUG nova.compute.manager [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:30:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:20 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-ef2ca6e9-c5ba-4b74-ad64-cf5e3cc13f3a req-077d23f6-ce6e-46d7-893f-1ce4a93e25e5 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received event network-vif-unplugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:30:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ef2ca6e9-c5ba-4b74-ad64-cf5e3cc13f3a req-077d23f6-ce6e-46d7-893f-1ce4a93e25e5 service nova] Acquiring lock "d89452ef-96ab-4081-bc40-0f64968de367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ef2ca6e9-c5ba-4b74-ad64-cf5e3cc13f3a req-077d23f6-ce6e-46d7-893f-1ce4a93e25e5 service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ef2ca6e9-c5ba-4b74-ad64-cf5e3cc13f3a req-077d23f6-ce6e-46d7-893f-1ce4a93e25e5 service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-ef2ca6e9-c5ba-4b74-ad64-cf5e3cc13f3a req-077d23f6-ce6e-46d7-893f-1ce4a93e25e5 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] No waiting events found dispatching network-vif-unplugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:30:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-ef2ca6e9-c5ba-4b74-ad64-cf5e3cc13f3a req-077d23f6-ce6e-46d7-893f-1ce4a93e25e5 service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received event network-vif-unplugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:30:21 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Instance destroyed successfully.
Nov 30 07:30:21 user nova-compute[75293]: DEBUG nova.objects.instance [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lazy-loading 'resources' on Instance uuid d89452ef-96ab-4081-bc40-0f64968de367 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1953113672',display_name='tempest-ServerActionsTestOtherB-server-1953113672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1953113672',id=35,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnRjCaWy780if2CkUOoZrcrdcD+P1g/YJnFZ7z8Y8pV7AT42ymHjcVO5HJTfrEuy5cWDNDXLYAnT+pwSMKRHRG0FXx2bJrOk/qq7N46wXruznAxyX6mXSnteMjD8Ewz6w==',key_name='tempest-keypair-319510887',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:27:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e631f0d47cc43a1b670e1b78b482e67',ramdisk_id='',reservation_id='r-mjklwfn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-70269142',owner_user_name='tempest-ServerActionsTestOtherB-70269142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:27:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fb08d8e90be4f6eb2efd21f2cbf2dcd',uuid=d89452ef-96ab-4081-bc40-0f64968de367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Converting VIF {"id": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "address": "fa:16:3e:8c:ff:ac", "network": {"id": "ed10d976-c4d3-43f4-8689-91af6c17cb21", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-235837065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e631f0d47cc43a1b670e1b78b482e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9bbab7-78", "ovs_interfaceid": "0b9bbab7-780f-4b09-9c9b-4448e8ff2323", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_vif [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b9bbab7-78, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ea0249b-798a-4da9-aed9-e20754d2a83b) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:30:21 user nova-compute[75293]: INFO os_vif [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ff:ac,bridge_name='br-int',has_traffic_filtering=True,id=0b9bbab7-780f-4b09-9c9b-4448e8ff2323,network=Network(ed10d976-c4d3-43f4-8689-91af6c17cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9bbab7-78')
Nov 30 07:30:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvteRwNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:30:21 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[de01a968-2532-4395-9b84-71a4953a8924]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:30:21 user nova-compute[75293]: No targets found.
Nov 30 07:30:21 user nova-compute[75293]: iSNS:
Nov 30 07:30:21 user nova-compute[75293]: No targets found.
Nov 30 07:30:21 user nova-compute[75293]: STATIC:
Nov 30 07:30:21 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:30:21 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:30:21 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:30:21 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf
Nov 30 07:30:21 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:30:21 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:30:21 user nova-compute[75293]: FIRMWARE:
Nov 30 07:30:21 user nova-compute[75293]: No targets found.
Nov 30 07:30:21 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:30:21 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:30:21 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c93e5f5-784d-43b9-a159-e4677c3ffbd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa981337-9dca-4ea6-997a-95f2dd128b7b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:30:21 user nova-compute[75293]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:30:21 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:30:21 user nova-compute[75293]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf (non-flash)
Nov 30 07:30:21 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe8075510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf'): ({'sdg'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Removing single pathed devices sdg {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0536a981-2141-46c3-a167-99397c160cf1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c615a9ab-d45d-48de-8c07-88cb2b90c7c6]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Flushing IO for device /dev/sdg {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a54116-1bd6-4741-9810-8ef573fa92ff]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d1a19f-30e3-4f20-b49b-08cd0c39ebcb]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] SCSI volumes sdg have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c61111-a77e-4969-9d99-f3cafb19a4ea]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cd589d-00e2-4ea7-8c87-216bc90716a1]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260]
Nov 30 07:30:21 user nova-compute[75293]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf, portal: 172.16.0.220,3260] successful.
Nov 30 07:30:21 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e982db5-ba1e-4b95-a127-1b44b7d7c6cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d215e67f-c3f7-41fd-944e-b8204f9e63f8]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] <== disconnect_volume: return (301ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:30:21 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Deleting instance files /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367_del
Nov 30 07:30:21 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Deletion of /opt/stack/data/nova/instances/d89452ef-96ab-4081-bc40-0f64968de367_del complete
Nov 30 07:30:21 user nova-compute[75293]: INFO nova.compute.manager [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 30 07:30:21 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:30:21 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: d89452ef-96ab-4081-bc40-0f64968de367] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:30:22 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:30:22 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Took 0.84 seconds to deallocate network for instance.
Nov 30 07:30:22 user nova-compute[75293]: DEBUG nova.compute.manager [req-bf154309-757b-4e31-9489-8a906484ca0e req-428b2391-5b1d-416c-9422-467ede46baae service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received event network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:30:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-bf154309-757b-4e31-9489-8a906484ca0e req-428b2391-5b1d-416c-9422-467ede46baae service nova] Acquiring lock "d89452ef-96ab-4081-bc40-0f64968de367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-bf154309-757b-4e31-9489-8a906484ca0e req-428b2391-5b1d-416c-9422-467ede46baae service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-bf154309-757b-4e31-9489-8a906484ca0e req-428b2391-5b1d-416c-9422-467ede46baae service nova] Lock "d89452ef-96ab-4081-bc40-0f64968de367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:22 user nova-compute[75293]: DEBUG nova.compute.manager [req-bf154309-757b-4e31-9489-8a906484ca0e req-428b2391-5b1d-416c-9422-467ede46baae service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] No waiting events found dispatching network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:30:22 user nova-compute[75293]: WARNING nova.compute.manager [req-bf154309-757b-4e31-9489-8a906484ca0e req-428b2391-5b1d-416c-9422-467ede46baae service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received unexpected event network-vif-plugged-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 for instance with vm_state active and task_state deleting.
Nov 30 07:30:22 user nova-compute[75293]: DEBUG nova.compute.manager [req-bf154309-757b-4e31-9489-8a906484ca0e req-428b2391-5b1d-416c-9422-467ede46baae service nova] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Received event network-vif-deleted-0b9bbab7-780f-4b09-9c9b-4448e8ff2323 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:30:23 user nova-compute[75293]: INFO nova.compute.manager [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] [instance: d89452ef-96ab-4081-bc40-0f64968de367] Took 0.77 seconds to detach 1 volumes for instance.
Nov 30 07:30:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:23 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:30:23 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:30:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:23 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Deleted allocations for instance d89452ef-96ab-4081-bc40-0f64968de367
Nov 30 07:30:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-7bb888cf-b62e-4cd1-80c8-065fe76d8d96 tempest-ServerActionsTestOtherB-70269142 tempest-ServerActionsTestOtherB-70269142-project-member] Lock "d89452ef-96ab-4081-bc40-0f64968de367" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.295s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:24 user nova-compute[75293]: INFO nova.compute.manager [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Terminating instance
Nov 30 07:30:24 user nova-compute[75293]: DEBUG nova.compute.manager [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:30:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-1b19171d-1179-4a40-8484-afc7e992c111 req-49f503c3-6d08-4f31-9231-adac3da3a830 service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Received event network-vif-unplugged-13a453d0-49aa-49ed-8032-18101893f071 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:30:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1b19171d-1179-4a40-8484-afc7e992c111 req-49f503c3-6d08-4f31-9231-adac3da3a830 service nova] Acquiring lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1b19171d-1179-4a40-8484-afc7e992c111 req-49f503c3-6d08-4f31-9231-adac3da3a830 service nova] Lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1b19171d-1179-4a40-8484-afc7e992c111 req-49f503c3-6d08-4f31-9231-adac3da3a830 service nova] Lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-1b19171d-1179-4a40-8484-afc7e992c111 req-49f503c3-6d08-4f31-9231-adac3da3a830 service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] No waiting events found dispatching network-vif-unplugged-13a453d0-49aa-49ed-8032-18101893f071 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:30:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-1b19171d-1179-4a40-8484-afc7e992c111 req-49f503c3-6d08-4f31-9231-adac3da3a830 service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Received event network-vif-unplugged-13a453d0-49aa-49ed-8032-18101893f071 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:30:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:24 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:25 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Instance destroyed successfully.
Nov 30 07:30:25 user nova-compute[75293]: DEBUG nova.objects.instance [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'resources' on Instance uuid 54c60b45-04dc-4d3b-96ec-c2d0f583cafa {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:30:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:21:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1391852437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1391852437',id=34,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:21:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f09e4044dadb4f2aa0d29f35f23008d2',ramdisk_id='',reservation_id='r-eltdo623',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:22:59Z,user_data=None,user_id='83119c1bbe4142a086680a113403018c',uuid=54c60b45-04dc-4d3b-96ec-c2d0f583cafa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13a453d0-49aa-49ed-8032-18101893f071", "address": "fa:16:3e:59:47:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a453d0-49", "ovs_interfaceid": "13a453d0-49aa-49ed-8032-18101893f071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:30:25 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converting VIF {"id": "13a453d0-49aa-49ed-8032-18101893f071", "address": "fa:16:3e:59:47:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a453d0-49", "ovs_interfaceid": "13a453d0-49aa-49ed-8032-18101893f071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:30:25 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:47:51,bridge_name='br-int',has_traffic_filtering=True,id=13a453d0-49aa-49ed-8032-18101893f071,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13a453d0-49') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:30:25 user nova-compute[75293]: DEBUG os_vif [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:47:51,bridge_name='br-int',has_traffic_filtering=True,id=13a453d0-49aa-49ed-8032-18101893f071,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13a453d0-49') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:30:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13a453d0-49, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:30:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b8b98f8-3432-4cd6-b4fd-0dc9d51576b9) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:30:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:25 user nova-compute[75293]: INFO os_vif [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:47:51,bridge_name='br-int',has_traffic_filtering=True,id=13a453d0-49aa-49ed-8032-18101893f071,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13a453d0-49')
Nov 30 07:30:25 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Deleting instance files /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa_del
Nov 30 07:30:25 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Deletion of /opt/stack/data/nova/instances/54c60b45-04dc-4d3b-96ec-c2d0f583cafa_del complete
Nov 30 07:30:25 user nova-compute[75293]: INFO nova.compute.manager [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 30 07:30:25 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:30:25 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:30:25 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:30:25 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:30:25 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Took 0.49 seconds to deallocate network for instance.
Nov 30 07:30:25 user nova-compute[75293]: DEBUG nova.compute.manager [req-6edf0d19-9b71-4aec-9e85-e603fa12e592 req-e6ee1432-603b-48e1-84b1-ca54166109d4 service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Received event network-vif-deleted-13a453d0-49aa-49ed-8032-18101893f071 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:30:25 user nova-compute[75293]: INFO nova.compute.manager [req-6edf0d19-9b71-4aec-9e85-e603fa12e592 req-e6ee1432-603b-48e1-84b1-ca54166109d4 service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Neutron deleted interface 13a453d0-49aa-49ed-8032-18101893f071; detaching it from the instance and deleting it from the info cache
Nov 30 07:30:25 user nova-compute[75293]: DEBUG nova.network.neutron [req-6edf0d19-9b71-4aec-9e85-e603fa12e592 req-e6ee1432-603b-48e1-84b1-ca54166109d4 service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:30:25 user nova-compute[75293]: DEBUG nova.compute.manager [req-6edf0d19-9b71-4aec-9e85-e603fa12e592 req-e6ee1432-603b-48e1-84b1-ca54166109d4 service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Detach interface failed, port_id=13a453d0-49aa-49ed-8032-18101893f071, reason: Instance 54c60b45-04dc-4d3b-96ec-c2d0f583cafa could not be found. {{(pid=75293) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 30 07:30:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:26 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:30:26 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:30:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:26 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Deleted allocations for instance 54c60b45-04dc-4d3b-96ec-c2d0f583cafa
Nov 30 07:30:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0c30c0ca-d059-4d2f-b15f-3ab5a39dbf34 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.707s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-4e5a51bf-ba25-455d-a496-31be7b76fa31 req-ecbea743-5273-4ad5-a2cd-12d566a32177 service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Received event network-vif-plugged-13a453d0-49aa-49ed-8032-18101893f071 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:30:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4e5a51bf-ba25-455d-a496-31be7b76fa31 req-ecbea743-5273-4ad5-a2cd-12d566a32177 service nova] Acquiring lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4e5a51bf-ba25-455d-a496-31be7b76fa31 req-ecbea743-5273-4ad5-a2cd-12d566a32177 service nova] Lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-4e5a51bf-ba25-455d-a496-31be7b76fa31 req-ecbea743-5273-4ad5-a2cd-12d566a32177 service nova] Lock "54c60b45-04dc-4d3b-96ec-c2d0f583cafa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:26 user nova-compute[75293]: DEBUG nova.compute.manager [req-4e5a51bf-ba25-455d-a496-31be7b76fa31 req-ecbea743-5273-4ad5-a2cd-12d566a32177 service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] No waiting events found dispatching network-vif-plugged-13a453d0-49aa-49ed-8032-18101893f071 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:30:26 user nova-compute[75293]: WARNING nova.compute.manager [req-4e5a51bf-ba25-455d-a496-31be7b76fa31 req-ecbea743-5273-4ad5-a2cd-12d566a32177 service nova] [instance: 54c60b45-04dc-4d3b-96ec-c2d0f583cafa] Received unexpected event network-vif-plugged-13a453d0-49aa-49ed-8032-18101893f071 for instance with vm_state deleted and task_state None.
Nov 30 07:30:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Acquiring lock "3aeab623-a85f-44d7-9ada-15df4910d953" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Lock "3aeab623-a85f-44d7-9ada-15df4910d953" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:30:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:27 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:30:27 user nova-compute[75293]: INFO nova.compute.claims [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Claim successful on node user
Nov 30 07:30:27 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:30:27 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:30:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG nova.compute.manager [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG nova.network.neutron [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:30:28 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:30:28 user nova-compute[75293]: DEBUG nova.compute.manager [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG nova.compute.manager [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:30:28 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Creating image(s)
Nov 30 07:30:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Acquiring lock "/opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Lock "/opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Lock "/opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG nova.policy [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a72417e8e550485a816a264ed60dc307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8505a73af81489483a492a2c3f78f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.201s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.180s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/disk 1073741824" returned: 0 in 0.050s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.183s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:28 user nova-compute[75293]: DEBUG nova.network.neutron [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Successfully created port: 6b56baae-9530-49e2-a5b1-57474bac4edf {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Cannot resize image /opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Ensure instance console log exists: /opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "3e25b799-6205-4724-bffc-f36e93c1ca98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "3e25b799-6205-4724-bffc-f36e93c1ca98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.compute.manager [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:30:29 user nova-compute[75293]: INFO nova.compute.claims [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Claim successful on node user
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.compute.manager [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.compute.manager [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.network.neutron [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.network.neutron [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Successfully updated port: 6b56baae-9530-49e2-a5b1-57474bac4edf {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:30:29 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Acquiring lock "refresh_cache-3aeab623-a85f-44d7-9ada-15df4910d953" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Acquired lock "refresh_cache-3aeab623-a85f-44d7-9ada-15df4910d953" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.network.neutron [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.compute.manager [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-0fffb4b7-6a4b-4c8c-8c5b-96c74696e55f req-b86f4d46-fff6-4c7d-8aec-4d7cd89d45f5 service nova] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Received event network-changed-6b56baae-9530-49e2-a5b1-57474bac4edf {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-0fffb4b7-6a4b-4c8c-8c5b-96c74696e55f req-b86f4d46-fff6-4c7d-8aec-4d7cd89d45f5 service nova] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Refreshing instance network info cache due to event network-changed-6b56baae-9530-49e2-a5b1-57474bac4edf. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0fffb4b7-6a4b-4c8c-8c5b-96c74696e55f req-b86f4d46-fff6-4c7d-8aec-4d7cd89d45f5 service nova] Acquiring lock "refresh_cache-3aeab623-a85f-44d7-9ada-15df4910d953" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.policy [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbee62d1b15144cc9d433a4a64dd12a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa84ea3874ba7ac0af4c3b1d2f918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.network.neutron [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:30:29 user nova-compute[75293]: INFO nova.virt.block_device [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Booting with volume 3b0b2927-e7ca-4b73-baf1-9d4c51b46dff at /dev/vda
Nov 30 07:30:29 user nova-compute[75293]: DEBUG os_brick.utils [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba35894-9574-4bd3-b647-6a331a3b30d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d73c592-c5d1-419f-ba11-5fe26b8cb3f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[af180b12-1237-4a3f-aeb1-70c2dde8a9d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ed0792-b153-46db-a883-6b0c470d6df0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:30:29 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc96e298-32cf-48df-b75f-4abbc78f8211]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG os_brick.utils [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Updating existing volume attachment record: c5cbe92b-75c4-44d4-906d-2df97a27e0a9 {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.network.neutron [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Updating instance_info_cache with network_info: [{"id": "6b56baae-9530-49e2-a5b1-57474bac4edf", "address": "fa:16:3e:bf:8a:51", "network": {"id": "b9e6e49f-b3d6-4857-8043-636a22f30f91", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "552643428120431f8bbeadca55f077de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b56baae-95", "ovs_interfaceid": "6b56baae-9530-49e2-a5b1-57474bac4edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Releasing lock "refresh_cache-3aeab623-a85f-44d7-9ada-15df4910d953" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.compute.manager [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Instance network_info: |[{"id": "6b56baae-9530-49e2-a5b1-57474bac4edf", "address": "fa:16:3e:bf:8a:51", "network": {"id": "b9e6e49f-b3d6-4857-8043-636a22f30f91", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "552643428120431f8bbeadca55f077de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b56baae-95", "ovs_interfaceid": "6b56baae-9530-49e2-a5b1-57474bac4edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0fffb4b7-6a4b-4c8c-8c5b-96c74696e55f req-b86f4d46-fff6-4c7d-8aec-4d7cd89d45f5 service nova] Acquired lock "refresh_cache-3aeab623-a85f-44d7-9ada-15df4910d953" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.network.neutron [req-0fffb4b7-6a4b-4c8c-8c5b-96c74696e55f req-b86f4d46-fff6-4c7d-8aec-4d7cd89d45f5 service nova] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Refreshing network info cache for port 6b56baae-9530-49e2-a5b1-57474bac4edf {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Start _get_guest_xml network_info=[{"id": "6b56baae-9530-49e2-a5b1-57474bac4edf", "address": "fa:16:3e:bf:8a:51", "network": {"id": "b9e6e49f-b3d6-4857-8043-636a22f30f91", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "552643428120431f8bbeadca55f077de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b56baae-95", "ovs_interfaceid": "6b56baae-9530-49e2-a5b1-57474bac4edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:30:29 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:30:29 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:30:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-548219607',display_name='tempest-VolumesNegativeTest-instance-548219607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-548219607',id=43,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8505a73af81489483a492a2c3f78f02',ramdisk_id='',reservation_id='r-0i3scmy6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1834648575',owner_user_name='tempest-VolumesNegativeTest-1834648575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:30:28Z,user_data=None,user_id='a72417e8e550485a816a264ed60dc307',uuid=3aeab623-a85f-44d7-9ada-15df4910d953,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b56baae-9530-49e2-a5b1-57474bac4edf", "address": "fa:16:3e:bf:8a:51", "network": {"id": "b9e6e49f-b3d6-4857-8043-636a22f30f91", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "552643428120431f8bbeadca55f077de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b56baae-95", "ovs_interfaceid": "6b56baae-9530-49e2-a5b1-57474bac4edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Converting VIF {"id": "6b56baae-9530-49e2-a5b1-57474bac4edf", "address": "fa:16:3e:bf:8a:51", "network": {"id": "b9e6e49f-b3d6-4857-8043-636a22f30f91", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "552643428120431f8bbeadca55f077de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b56baae-95", "ovs_interfaceid": "6b56baae-9530-49e2-a5b1-57474bac4edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:8a:51,bridge_name='br-int',has_traffic_filtering=True,id=6b56baae-9530-49e2-a5b1-57474bac4edf,network=Network(b9e6e49f-b3d6-4857-8043-636a22f30f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b56baae-95') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.objects.instance [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Lazy-loading 'pci_devices' on Instance uuid 3aeab623-a85f-44d7-9ada-15df4910d953 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:30:29 user nova-compute[75293]:   <uuid>3aeab623-a85f-44d7-9ada-15df4910d953</uuid>
Nov 30 07:30:29 user nova-compute[75293]:   <name>instance-0000002b</name>
Nov 30 07:30:29 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:30:29 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:30:29 user nova-compute[75293]:   <metadata>
Nov 30 07:30:29 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:30:29 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:30:29 user nova-compute[75293]:       <nova:name>tempest-VolumesNegativeTest-instance-548219607</nova:name>
Nov 30 07:30:29 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:30:29</nova:creationTime>
Nov 30 07:30:29 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:30:29 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:30:29 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:30:29 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:30:29 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:30:29 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:30:29 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:30:29 user nova-compute[75293]:       <nova:owner>
Nov 30 07:30:29 user nova-compute[75293]:         <nova:user uuid="a72417e8e550485a816a264ed60dc307">tempest-VolumesNegativeTest-1834648575-project-member</nova:user>
Nov 30 07:30:29 user nova-compute[75293]:         <nova:project uuid="a8505a73af81489483a492a2c3f78f02">tempest-VolumesNegativeTest-1834648575</nova:project>
Nov 30 07:30:29 user nova-compute[75293]:       </nova:owner>
Nov 30 07:30:29 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:30:29 user nova-compute[75293]:       <nova:ports>
Nov 30 07:30:29 user nova-compute[75293]:         <nova:port uuid="6b56baae-9530-49e2-a5b1-57474bac4edf">
Nov 30 07:30:29 user nova-compute[75293]:           <nova:ip type="fixed" address="192.168.233.23" ipVersion="4"/>
Nov 30 07:30:29 user nova-compute[75293]:         </nova:port>
Nov 30 07:30:29 user nova-compute[75293]:       </nova:ports>
Nov 30 07:30:29 user nova-compute[75293]:     </nova:instance>
Nov 30 07:30:29 user nova-compute[75293]:   </metadata>
Nov 30 07:30:29 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:30:29 user nova-compute[75293]:     <system>
Nov 30 07:30:29 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:30:29 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:30:29 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:30:29 user nova-compute[75293]:       <entry name="serial">3aeab623-a85f-44d7-9ada-15df4910d953</entry>
Nov 30 07:30:29 user nova-compute[75293]:       <entry name="uuid">3aeab623-a85f-44d7-9ada-15df4910d953</entry>
Nov 30 07:30:29 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:30:29 user nova-compute[75293]:     </system>
Nov 30 07:30:29 user nova-compute[75293]:   </sysinfo>
Nov 30 07:30:29 user nova-compute[75293]:   <os>
Nov 30 07:30:29 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:30:29 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:30:29 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:30:29 user nova-compute[75293]:   </os>
Nov 30 07:30:29 user nova-compute[75293]:   <features>
Nov 30 07:30:29 user nova-compute[75293]:     <acpi/>
Nov 30 07:30:29 user nova-compute[75293]:     <apic/>
Nov 30 07:30:29 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:30:29 user nova-compute[75293]:   </features>
Nov 30 07:30:29 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:30:29 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:30:29 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:30:29 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:30:29 user nova-compute[75293]:   </clock>
Nov 30 07:30:29 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:30:29 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:30:29 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:30:29 user nova-compute[75293]:   </cpu>
Nov 30 07:30:29 user nova-compute[75293]:   <devices>
Nov 30 07:30:29 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:30:29 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:30:29 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/disk"/>
Nov 30 07:30:29 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:30:29 user nova-compute[75293]:     </disk>
Nov 30 07:30:29 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:30:29 user nova-compute[75293]:       <mac address="fa:16:3e:bf:8a:51"/>
Nov 30 07:30:29 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:30:29 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:30:29 user nova-compute[75293]:       <target dev="tap6b56baae-95"/>
Nov 30 07:30:29 user nova-compute[75293]:     </interface>
Nov 30 07:30:29 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:30:29 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/console.log" append="off"/>
Nov 30 07:30:29 user nova-compute[75293]:     </serial>
Nov 30 07:30:29 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:30:29 user nova-compute[75293]:     <video>
Nov 30 07:30:29 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:30:29 user nova-compute[75293]:     </video>
Nov 30 07:30:29 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:30:29 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:30:29 user nova-compute[75293]:     </rng>
Nov 30 07:30:29 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:30:29 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:30:29 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:30:29 user nova-compute[75293]:     </memballoon>
Nov 30 07:30:29 user nova-compute[75293]:   </devices>
Nov 30 07:30:29 user nova-compute[75293]: </domain>
Nov 30 07:30:29 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:30:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-548219607',display_name='tempest-VolumesNegativeTest-instance-548219607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-548219607',id=43,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8505a73af81489483a492a2c3f78f02',ramdisk_id='',reservation_id='r-0i3scmy6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1834648575',owner_user_name='tempest-VolumesNegativeTest-1834648575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:30:28Z,user_data=None,user_id='a72417e8e550485a816a264ed60dc307',uuid=3aeab623-a85f-44d7-9ada-15df4910d953,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b56baae-9530-49e2-a5b1-57474bac4edf", "address": "fa:16:3e:bf:8a:51", "network": {"id": "b9e6e49f-b3d6-4857-8043-636a22f30f91", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "552643428120431f8bbeadca55f077de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b56baae-95", "ovs_interfaceid": "6b56baae-9530-49e2-a5b1-57474bac4edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Converting VIF {"id": "6b56baae-9530-49e2-a5b1-57474bac4edf", "address": "fa:16:3e:bf:8a:51", "network": {"id": "b9e6e49f-b3d6-4857-8043-636a22f30f91", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "552643428120431f8bbeadca55f077de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b56baae-95", "ovs_interfaceid": "6b56baae-9530-49e2-a5b1-57474bac4edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:8a:51,bridge_name='br-int',has_traffic_filtering=True,id=6b56baae-9530-49e2-a5b1-57474bac4edf,network=Network(b9e6e49f-b3d6-4857-8043-636a22f30f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b56baae-95') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG os_vif [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:8a:51,bridge_name='br-int',has_traffic_filtering=True,id=6b56baae-9530-49e2-a5b1-57474bac4edf,network=Network(b9e6e49f-b3d6-4857-8043-636a22f30f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b56baae-95') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf576c70-edf3-5ae8-8e23-ffd416f4b4e3', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b56baae-95, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b56baae-95, col_values=(('qos', UUID('d27252d1-4153-427a-a4b5-032ff9f6b007')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b56baae-95, col_values=(('external_ids', {'iface-id': '6b56baae-9530-49e2-a5b1-57474bac4edf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:8a:51', 'vm-uuid': '3aeab623-a85f-44d7-9ada-15df4910d953'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:30:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:29 user nova-compute[75293]: INFO os_vif [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:8a:51,bridge_name='br-int',has_traffic_filtering=True,id=6b56baae-9530-49e2-a5b1-57474bac4edf,network=Network(b9e6e49f-b3d6-4857-8043-636a22f30f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b56baae-95')
Nov 30 07:30:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:30:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] No VIF found with MAC fa:16:3e:bf:8a:51, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:30:30 user nova-compute[75293]: DEBUG nova.network.neutron [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Successfully created port: 9570c6c3-691c-46d0-8922-7679cac177a3 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:30:30 user nova-compute[75293]: DEBUG nova.network.neutron [req-0fffb4b7-6a4b-4c8c-8c5b-96c74696e55f req-b86f4d46-fff6-4c7d-8aec-4d7cd89d45f5 service nova] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Updated VIF entry in instance network info cache for port 6b56baae-9530-49e2-a5b1-57474bac4edf. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:30:30 user nova-compute[75293]: DEBUG nova.network.neutron [req-0fffb4b7-6a4b-4c8c-8c5b-96c74696e55f req-b86f4d46-fff6-4c7d-8aec-4d7cd89d45f5 service nova] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Updating instance_info_cache with network_info: [{"id": "6b56baae-9530-49e2-a5b1-57474bac4edf", "address": "fa:16:3e:bf:8a:51", "network": {"id": "b9e6e49f-b3d6-4857-8043-636a22f30f91", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "552643428120431f8bbeadca55f077de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b56baae-95", "ovs_interfaceid": "6b56baae-9530-49e2-a5b1-57474bac4edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:30:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-0fffb4b7-6a4b-4c8c-8c5b-96c74696e55f req-b86f4d46-fff6-4c7d-8aec-4d7cd89d45f5 service nova] Releasing lock "refresh_cache-3aeab623-a85f-44d7-9ada-15df4910d953" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:30:30 user nova-compute[75293]: DEBUG nova.network.neutron [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Successfully updated port: 9570c6c3-691c-46d0-8922-7679cac177a3 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:30:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "refresh_cache-3e25b799-6205-4724-bffc-f36e93c1ca98" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:30:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquired lock "refresh_cache-3e25b799-6205-4724-bffc-f36e93c1ca98" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:30:30 user nova-compute[75293]: DEBUG nova.network.neutron [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:30:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-c003537e-862c-477e-a18d-37be200a4991 req-55649a0d-7e2e-4a90-8bce-dbf4e53010e2 service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Received event network-changed-9570c6c3-691c-46d0-8922-7679cac177a3 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:30:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-c003537e-862c-477e-a18d-37be200a4991 req-55649a0d-7e2e-4a90-8bce-dbf4e53010e2 service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Refreshing instance network info cache due to event network-changed-9570c6c3-691c-46d0-8922-7679cac177a3. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:30:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c003537e-862c-477e-a18d-37be200a4991 req-55649a0d-7e2e-4a90-8bce-dbf4e53010e2 service nova] Acquiring lock "refresh_cache-3e25b799-6205-4724-bffc-f36e93c1ca98" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:30:30 user nova-compute[75293]: DEBUG nova.network.neutron [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:30:31 user nova-compute[75293]: DEBUG nova.network.neutron [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Updating instance_info_cache with network_info: [{"id": "9570c6c3-691c-46d0-8922-7679cac177a3", "address": "fa:16:3e:95:9e:b8", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9570c6c3-69", "ovs_interfaceid": "9570c6c3-691c-46d0-8922-7679cac177a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:30:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Releasing lock "refresh_cache-3e25b799-6205-4724-bffc-f36e93c1ca98" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:30:31 user nova-compute[75293]: DEBUG nova.compute.manager [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Instance network_info: |[{"id": "9570c6c3-691c-46d0-8922-7679cac177a3", "address": "fa:16:3e:95:9e:b8", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9570c6c3-69", "ovs_interfaceid": "9570c6c3-691c-46d0-8922-7679cac177a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:30:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c003537e-862c-477e-a18d-37be200a4991 req-55649a0d-7e2e-4a90-8bce-dbf4e53010e2 service nova] Acquired lock "refresh_cache-3e25b799-6205-4724-bffc-f36e93c1ca98" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:30:31 user nova-compute[75293]: DEBUG nova.network.neutron [req-c003537e-862c-477e-a18d-37be200a4991 req-55649a0d-7e2e-4a90-8bce-dbf4e53010e2 service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Refreshing network info cache for port 9570c6c3-691c-46d0-8922-7679cac177a3 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:30:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:31 user nova-compute[75293]: DEBUG nova.network.neutron [req-c003537e-862c-477e-a18d-37be200a4991 req-55649a0d-7e2e-4a90-8bce-dbf4e53010e2 service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Updated VIF entry in instance network info cache for port 9570c6c3-691c-46d0-8922-7679cac177a3. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:30:31 user nova-compute[75293]: DEBUG nova.network.neutron [req-c003537e-862c-477e-a18d-37be200a4991 req-55649a0d-7e2e-4a90-8bce-dbf4e53010e2 service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Updating instance_info_cache with network_info: [{"id": "9570c6c3-691c-46d0-8922-7679cac177a3", "address": "fa:16:3e:95:9e:b8", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9570c6c3-69", "ovs_interfaceid": "9570c6c3-691c-46d0-8922-7679cac177a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:30:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c003537e-862c-477e-a18d-37be200a4991 req-55649a0d-7e2e-4a90-8bce-dbf4e53010e2 service nova] Releasing lock "refresh_cache-3e25b799-6205-4724-bffc-f36e93c1ca98" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:30:31 user nova-compute[75293]: DEBUG nova.compute.manager [req-a2b1fad7-fc37-4d9e-b997-2f25cd5bd6ee req-0d714e55-8f7e-4f2c-907f-c4e7f85b8c53 service nova] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Received event network-vif-plugged-6b56baae-9530-49e2-a5b1-57474bac4edf {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:30:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a2b1fad7-fc37-4d9e-b997-2f25cd5bd6ee req-0d714e55-8f7e-4f2c-907f-c4e7f85b8c53 service nova] Acquiring lock "3aeab623-a85f-44d7-9ada-15df4910d953-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a2b1fad7-fc37-4d9e-b997-2f25cd5bd6ee req-0d714e55-8f7e-4f2c-907f-c4e7f85b8c53 service nova] Lock "3aeab623-a85f-44d7-9ada-15df4910d953-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a2b1fad7-fc37-4d9e-b997-2f25cd5bd6ee req-0d714e55-8f7e-4f2c-907f-c4e7f85b8c53 service nova] Lock "3aeab623-a85f-44d7-9ada-15df4910d953-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:31 user nova-compute[75293]: DEBUG nova.compute.manager [req-a2b1fad7-fc37-4d9e-b997-2f25cd5bd6ee req-0d714e55-8f7e-4f2c-907f-c4e7f85b8c53 service nova] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] No waiting events found dispatching network-vif-plugged-6b56baae-9530-49e2-a5b1-57474bac4edf {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:30:31 user nova-compute[75293]: WARNING nova.compute.manager [req-a2b1fad7-fc37-4d9e-b997-2f25cd5bd6ee req-0d714e55-8f7e-4f2c-907f-c4e7f85b8c53 service nova] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Received unexpected event network-vif-plugged-6b56baae-9530-49e2-a5b1-57474bac4edf for instance with vm_state building and task_state spawning.
Nov 30 07:30:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:33 user nova-compute[75293]: DEBUG nova.compute.manager [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:30:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:30:33 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Instance spawned successfully.
Nov 30 07:30:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:30:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:30:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:30:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:30:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:30:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:30:33 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:30:33 user nova-compute[75293]: INFO nova.compute.manager [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 30 07:30:33 user nova-compute[75293]: DEBUG nova.compute.manager [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:30:33 user nova-compute[75293]: DEBUG nova.compute.manager [req-105bc39b-8b7c-4bb9-911c-82db4952f868 req-2ef31452-b64e-4922-be45-8f8eec09a63b service nova] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Received event network-vif-plugged-6b56baae-9530-49e2-a5b1-57474bac4edf {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:30:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-105bc39b-8b7c-4bb9-911c-82db4952f868 req-2ef31452-b64e-4922-be45-8f8eec09a63b service nova] Acquiring lock "3aeab623-a85f-44d7-9ada-15df4910d953-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-105bc39b-8b7c-4bb9-911c-82db4952f868 req-2ef31452-b64e-4922-be45-8f8eec09a63b service nova] Lock "3aeab623-a85f-44d7-9ada-15df4910d953-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-105bc39b-8b7c-4bb9-911c-82db4952f868 req-2ef31452-b64e-4922-be45-8f8eec09a63b service nova] Lock "3aeab623-a85f-44d7-9ada-15df4910d953-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:33 user nova-compute[75293]: DEBUG nova.compute.manager [req-105bc39b-8b7c-4bb9-911c-82db4952f868 req-2ef31452-b64e-4922-be45-8f8eec09a63b service nova] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] No waiting events found dispatching network-vif-plugged-6b56baae-9530-49e2-a5b1-57474bac4edf {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:30:33 user nova-compute[75293]: WARNING nova.compute.manager [req-105bc39b-8b7c-4bb9-911c-82db4952f868 req-2ef31452-b64e-4922-be45-8f8eec09a63b service nova] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Received unexpected event network-vif-plugged-6b56baae-9530-49e2-a5b1-57474bac4edf for instance with vm_state building and task_state spawning.
Nov 30 07:30:33 user nova-compute[75293]: INFO nova.compute.manager [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Took 5.90 seconds to build instance.
Nov 30 07:30:33 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-62e57ab7-379e-4f03-a4eb-744e57e8bc54 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Lock "3aeab623-a85f-44d7-9ada-15df4910d953" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.991s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:34 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.compute.manager [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:30:38 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Creating image(s)
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Did not create local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Ensure instance console log exists: /opt/stack/data/nova/instances/3e25b799-6205-4724-bffc-f36e93c1ca98/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Start _get_guest_xml network_info=[{"id": "9570c6c3-691c-46d0-8922-7679cac177a3", "address": "fa:16:3e:95:9e:b8", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9570c6c3-69", "ovs_interfaceid": "9570c6c3-691c-46d0-8922-7679cac177a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvFEBmco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3e25b799-6205-4724-bffc-f36e93c1ca98', 'attached_at': '', 'detached_at': '', 'volume_id': '3b0b2927-e7ca-4b73-baf1-9d4c51b46dff', 'serial': '3b0b2927-e7ca-4b73-baf1-9d4c51b46dff'}, 'delete_on_termination': False, 'attachment_id': 'c5cbe92b-75c4-44d4-906d-2df97a27e0a9', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:30:38 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:30:38 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvFEBmco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:30:38 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:30:38 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:30:38 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91c71a1-cad7-4c79-8726-71945bc02839]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:30:38 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed41e651-7dce-44f6-8f06-277feba564bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff] added
Nov 30 07:30:38 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[9960b0c9-9c5b-451a-8dc6-f498d9209bdf]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d0a0ba-4799-4cab-acc2-1f6e4e71bbc5]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvFEBmco {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvFEBmco" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[925c3d10-d511-4116-8f1e-d620c08cc6d2]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MvFEBmco'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b9b5bd-1c6a-49a0-aed0-c8b5c06724e1]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1572411-1ebd-4247-afd4-700d3fd75cf0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:30:38 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:30:38 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[12656905-a06d-43c0-b8d9-20b0d1338ea1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff, portal: 172.16.0.220,3260]
Nov 30 07:30:38 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff, portal: 172.16.0.220,3260] successful.
Nov 30 07:30:38 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d86c7b-4364-48a2-9c8e-e40bc0c5401a]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[547f9049-bb4e-48b1-9bd5-82d04629576b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:30:38 user nova-compute[75293]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff (non-flash)
Nov 30 07:30:38 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:30:38 user nova-compute[75293]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff (non-flash)
Nov 30 07:30:38 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.031s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fd6aeb-4523-41da-b3c9-8959bb036be1]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:30:38 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvFEBmco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26234373535356533', 'path': '/dev/sdb'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234373535356533', 'path': '/dev/sdb'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:30:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1626084373',display_name='tempest-TestVolumeBootPattern-server-1626084373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1626084373',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjYpNawIGYigccNKqOMu5B2KkHiW6PJtAwx4gnV2Bz3ppJhyMPL2myvnkPDsvqitKRsm9L8h5UrColCNNTtOYkZ/lhfNHFXjjmmY5PKfn3zACvSADMpOWwtUHdyXG+/2Q==',key_name='tempest-TestVolumeBootPattern-112031280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4bfa84ea3874ba7ac0af4c3b1d2f918',ramdisk_id='',reservation_id='r-iugzfhqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273596612',owner_user_name='tempest-TestVolumeBootPattern-273596612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:30:30Z,user_data=None,user_id='fbee62d1b15144cc9d433a4a64dd12a7',uuid=3e25b799-6205-4724-bffc-f36e93c1ca98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9570c6c3-691c-46d0-8922-7679cac177a3", "address": "fa:16:3e:95:9e:b8", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9570c6c3-69", "ovs_interfaceid": "9570c6c3-691c-46d0-8922-7679cac177a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converting VIF {"id": "9570c6c3-691c-46d0-8922-7679cac177a3", "address": "fa:16:3e:95:9e:b8", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9570c6c3-69", "ovs_interfaceid": "9570c6c3-691c-46d0-8922-7679cac177a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:9e:b8,bridge_name='br-int',has_traffic_filtering=True,id=9570c6c3-691c-46d0-8922-7679cac177a3,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9570c6c3-69') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG nova.objects.instance [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e25b799-6205-4724-bffc-f36e93c1ca98 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:30:39 user nova-compute[75293]:   <uuid>3e25b799-6205-4724-bffc-f36e93c1ca98</uuid>
Nov 30 07:30:39 user nova-compute[75293]:   <name>instance-0000002c</name>
Nov 30 07:30:39 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:30:39 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:30:39 user nova-compute[75293]:   <metadata>
Nov 30 07:30:39 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:30:39 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:30:39 user nova-compute[75293]:       <nova:name>tempest-TestVolumeBootPattern-server-1626084373</nova:name>
Nov 30 07:30:39 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:30:38</nova:creationTime>
Nov 30 07:30:39 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:30:39 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:30:39 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:30:39 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:30:39 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:30:39 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:30:39 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:30:39 user nova-compute[75293]:       <nova:owner>
Nov 30 07:30:39 user nova-compute[75293]:         <nova:user uuid="fbee62d1b15144cc9d433a4a64dd12a7">tempest-TestVolumeBootPattern-273596612-project-member</nova:user>
Nov 30 07:30:39 user nova-compute[75293]:         <nova:project uuid="e4bfa84ea3874ba7ac0af4c3b1d2f918">tempest-TestVolumeBootPattern-273596612</nova:project>
Nov 30 07:30:39 user nova-compute[75293]:       </nova:owner>
Nov 30 07:30:39 user nova-compute[75293]:       <nova:ports>
Nov 30 07:30:39 user nova-compute[75293]:         <nova:port uuid="9570c6c3-691c-46d0-8922-7679cac177a3">
Nov 30 07:30:39 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 30 07:30:39 user nova-compute[75293]:         </nova:port>
Nov 30 07:30:39 user nova-compute[75293]:       </nova:ports>
Nov 30 07:30:39 user nova-compute[75293]:     </nova:instance>
Nov 30 07:30:39 user nova-compute[75293]:   </metadata>
Nov 30 07:30:39 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:30:39 user nova-compute[75293]:     <system>
Nov 30 07:30:39 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:30:39 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:30:39 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:30:39 user nova-compute[75293]:       <entry name="serial">3e25b799-6205-4724-bffc-f36e93c1ca98</entry>
Nov 30 07:30:39 user nova-compute[75293]:       <entry name="uuid">3e25b799-6205-4724-bffc-f36e93c1ca98</entry>
Nov 30 07:30:39 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:30:39 user nova-compute[75293]:     </system>
Nov 30 07:30:39 user nova-compute[75293]:   </sysinfo>
Nov 30 07:30:39 user nova-compute[75293]:   <os>
Nov 30 07:30:39 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:30:39 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:30:39 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:30:39 user nova-compute[75293]:   </os>
Nov 30 07:30:39 user nova-compute[75293]:   <features>
Nov 30 07:30:39 user nova-compute[75293]:     <acpi/>
Nov 30 07:30:39 user nova-compute[75293]:     <apic/>
Nov 30 07:30:39 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:30:39 user nova-compute[75293]:   </features>
Nov 30 07:30:39 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:30:39 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:30:39 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:30:39 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:30:39 user nova-compute[75293]:   </clock>
Nov 30 07:30:39 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:30:39 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:30:39 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:30:39 user nova-compute[75293]:   </cpu>
Nov 30 07:30:39 user nova-compute[75293]:   <devices>
Nov 30 07:30:39 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:30:39 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:30:39 user nova-compute[75293]:       <source dev="/dev/sdb"/>
Nov 30 07:30:39 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:30:39 user nova-compute[75293]:       <serial>3b0b2927-e7ca-4b73-baf1-9d4c51b46dff</serial>
Nov 30 07:30:39 user nova-compute[75293]:     </disk>
Nov 30 07:30:39 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:30:39 user nova-compute[75293]:       <mac address="fa:16:3e:95:9e:b8"/>
Nov 30 07:30:39 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:30:39 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:30:39 user nova-compute[75293]:       <target dev="tap9570c6c3-69"/>
Nov 30 07:30:39 user nova-compute[75293]:     </interface>
Nov 30 07:30:39 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:30:39 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/3e25b799-6205-4724-bffc-f36e93c1ca98/console.log" append="off"/>
Nov 30 07:30:39 user nova-compute[75293]:     </serial>
Nov 30 07:30:39 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:30:39 user nova-compute[75293]:     <video>
Nov 30 07:30:39 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:30:39 user nova-compute[75293]:     </video>
Nov 30 07:30:39 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:30:39 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:30:39 user nova-compute[75293]:     </rng>
Nov 30 07:30:39 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:30:39 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:30:39 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:30:39 user nova-compute[75293]:     </memballoon>
Nov 30 07:30:39 user nova-compute[75293]:   </devices>
Nov 30 07:30:39 user nova-compute[75293]: </domain>
Nov 30 07:30:39 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:30:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1626084373',display_name='tempest-TestVolumeBootPattern-server-1626084373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1626084373',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjYpNawIGYigccNKqOMu5B2KkHiW6PJtAwx4gnV2Bz3ppJhyMPL2myvnkPDsvqitKRsm9L8h5UrColCNNTtOYkZ/lhfNHFXjjmmY5PKfn3zACvSADMpOWwtUHdyXG+/2Q==',key_name='tempest-TestVolumeBootPattern-112031280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4bfa84ea3874ba7ac0af4c3b1d2f918',ramdisk_id='',reservation_id='r-iugzfhqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273596612',owner_user_name='tempest-TestVolumeBootPattern-273596612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:30:30Z,user_data=None,user_id='fbee62d1b15144cc9d433a4a64dd12a7',uuid=3e25b799-6205-4724-bffc-f36e93c1ca98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9570c6c3-691c-46d0-8922-7679cac177a3", "address": "fa:16:3e:95:9e:b8", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9570c6c3-69", "ovs_interfaceid": "9570c6c3-691c-46d0-8922-7679cac177a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converting VIF {"id": "9570c6c3-691c-46d0-8922-7679cac177a3", "address": "fa:16:3e:95:9e:b8", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9570c6c3-69", "ovs_interfaceid": "9570c6c3-691c-46d0-8922-7679cac177a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:9e:b8,bridge_name='br-int',has_traffic_filtering=True,id=9570c6c3-691c-46d0-8922-7679cac177a3,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9570c6c3-69') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG os_vif [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:9e:b8,bridge_name='br-int',has_traffic_filtering=True,id=9570c6c3-691c-46d0-8922-7679cac177a3,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9570c6c3-69') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1c59cd4-3817-5b18-b696-98ff5e31d9fd', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9570c6c3-69, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9570c6c3-69, col_values=(('qos', UUID('1c803251-6e32-4643-8b01-4ea32d08ea98')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9570c6c3-69, col_values=(('external_ids', {'iface-id': '9570c6c3-691c-46d0-8922-7679cac177a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:9e:b8', 'vm-uuid': '3e25b799-6205-4724-bffc-f36e93c1ca98'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:39 user nova-compute[75293]: INFO os_vif [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:9e:b8,bridge_name='br-int',has_traffic_filtering=True,id=9570c6c3-691c-46d0-8922-7679cac177a3,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9570c6c3-69')
Nov 30 07:30:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:30:39 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] No VIF found with MAC fa:16:3e:95:9e:b8, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:30:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:41 user nova-compute[75293]: DEBUG nova.compute.manager [req-103c7a4e-dfb1-44f0-870f-fc1bb204788e req-db8c0888-e352-4d11-accd-91fb6f9c948d service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Received event network-vif-plugged-9570c6c3-691c-46d0-8922-7679cac177a3 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:30:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-103c7a4e-dfb1-44f0-870f-fc1bb204788e req-db8c0888-e352-4d11-accd-91fb6f9c948d service nova] Acquiring lock "3e25b799-6205-4724-bffc-f36e93c1ca98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-103c7a4e-dfb1-44f0-870f-fc1bb204788e req-db8c0888-e352-4d11-accd-91fb6f9c948d service nova] Lock "3e25b799-6205-4724-bffc-f36e93c1ca98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:41 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-103c7a4e-dfb1-44f0-870f-fc1bb204788e req-db8c0888-e352-4d11-accd-91fb6f9c948d service nova] Lock "3e25b799-6205-4724-bffc-f36e93c1ca98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:41 user nova-compute[75293]: DEBUG nova.compute.manager [req-103c7a4e-dfb1-44f0-870f-fc1bb204788e req-db8c0888-e352-4d11-accd-91fb6f9c948d service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] No waiting events found dispatching network-vif-plugged-9570c6c3-691c-46d0-8922-7679cac177a3 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:30:41 user nova-compute[75293]: WARNING nova.compute.manager [req-103c7a4e-dfb1-44f0-870f-fc1bb204788e req-db8c0888-e352-4d11-accd-91fb6f9c948d service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Received unexpected event network-vif-plugged-9570c6c3-691c-46d0-8922-7679cac177a3 for instance with vm_state building and task_state spawning.
Nov 30 07:30:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:43 user nova-compute[75293]: DEBUG nova.compute.manager [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:30:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:30:43 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Instance spawned successfully.
Nov 30 07:30:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:30:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:30:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:30:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:30:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:30:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:30:43 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:30:43 user nova-compute[75293]: INFO nova.compute.manager [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 30 07:30:43 user nova-compute[75293]: DEBUG nova.compute.manager [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:30:43 user nova-compute[75293]: INFO nova.compute.manager [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Took 14.07 seconds to build instance.
Nov 30 07:30:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-c1b58754-0e87-4239-adc1-babb78785103 req-bbfbc2a6-2dbf-43a1-992a-fb1688648e5c service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Received event network-vif-plugged-9570c6c3-691c-46d0-8922-7679cac177a3 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:30:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c1b58754-0e87-4239-adc1-babb78785103 req-bbfbc2a6-2dbf-43a1-992a-fb1688648e5c service nova] Acquiring lock "3e25b799-6205-4724-bffc-f36e93c1ca98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:30:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c1b58754-0e87-4239-adc1-babb78785103 req-bbfbc2a6-2dbf-43a1-992a-fb1688648e5c service nova] Lock "3e25b799-6205-4724-bffc-f36e93c1ca98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:30:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c1b58754-0e87-4239-adc1-babb78785103 req-bbfbc2a6-2dbf-43a1-992a-fb1688648e5c service nova] Lock "3e25b799-6205-4724-bffc-f36e93c1ca98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:43 user nova-compute[75293]: DEBUG nova.compute.manager [req-c1b58754-0e87-4239-adc1-babb78785103 req-bbfbc2a6-2dbf-43a1-992a-fb1688648e5c service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] No waiting events found dispatching network-vif-plugged-9570c6c3-691c-46d0-8922-7679cac177a3 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:30:43 user nova-compute[75293]: WARNING nova.compute.manager [req-c1b58754-0e87-4239-adc1-babb78785103 req-bbfbc2a6-2dbf-43a1-992a-fb1688648e5c service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Received unexpected event network-vif-plugged-9570c6c3-691c-46d0-8922-7679cac177a3 for instance with vm_state active and task_state None.
Nov 30 07:30:43 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-13e9cefb-3c58-4fbf-bf3c-75f888b7df63 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "3e25b799-6205-4724-bffc-f36e93c1ca98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.163s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:30:44 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:49 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:54 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:30:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:01 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:31:02 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:31:02 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:31:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:05 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:31:05 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:31:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:06 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:31:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:06 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:31:06 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:31:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:07 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:07 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:31:08 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:31:08 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:31:08 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=8554MB free_disk=25.010677337646484GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:31:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:08 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance c8d1df78-2aa2-4710-a570-5f72c60cfc26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:31:08 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:31:08 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 3aeab623-a85f-44d7-9ada-15df4910d953 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:31:08 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 3e25b799-6205-4724-bffc-f36e93c1ca98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:31:08 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:31:08 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:31:08 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:31:08 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:31:08 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:31:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:09 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:31:09 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:10 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:31:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:11 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:31:11 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:31:11 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Rebuilding the list of instances to heal {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 07:31:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-c8d1df78-2aa2-4710-a570-5f72c60cfc26" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:31:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-c8d1df78-2aa2-4710-a570-5f72c60cfc26" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:31:11 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:31:11 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lazy-loading 'info_cache' on Instance uuid c8d1df78-2aa2-4710-a570-5f72c60cfc26 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:31:12 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Updating instance_info_cache with network_info: [{"id": "66299713-0237-47db-9fef-e5816beed9d9", "address": "fa:16:3e:db:c2:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66299713-02", "ovs_interfaceid": "66299713-0237-47db-9fef-e5816beed9d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:31:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-c8d1df78-2aa2-4710-a570-5f72c60cfc26" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:31:12 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:31:12 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:31:14 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:15 user nova-compute[75293]: INFO nova.compute.manager [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Terminating instance
Nov 30 07:31:15 user nova-compute[75293]: DEBUG nova.compute.manager [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:31:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-600a5646-02e5-47dd-b2b1-427e48652e35 req-d91cc3ba-1989-4326-84c5-d28d8a950d52 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received event network-vif-unplugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:31:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-600a5646-02e5-47dd-b2b1-427e48652e35 req-d91cc3ba-1989-4326-84c5-d28d8a950d52 service nova] Acquiring lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-600a5646-02e5-47dd-b2b1-427e48652e35 req-d91cc3ba-1989-4326-84c5-d28d8a950d52 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-600a5646-02e5-47dd-b2b1-427e48652e35 req-d91cc3ba-1989-4326-84c5-d28d8a950d52 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-600a5646-02e5-47dd-b2b1-427e48652e35 req-d91cc3ba-1989-4326-84c5-d28d8a950d52 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] No waiting events found dispatching network-vif-unplugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:31:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-600a5646-02e5-47dd-b2b1-427e48652e35 req-d91cc3ba-1989-4326-84c5-d28d8a950d52 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received event network-vif-unplugged-094f0848-c129-4499-8781-6943982188b6 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:31:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:15 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:16 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Instance destroyed successfully.
Nov 30 07:31:16 user nova-compute[75293]: DEBUG nova.objects.instance [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'resources' on Instance uuid 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:15:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-542946188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-542946188',id=26,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:17:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f09e4044dadb4f2aa0d29f35f23008d2',ramdisk_id='',reservation_id='r-wj45bcq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:19:15Z,user_data=None,user_id='83119c1bbe4142a086680a113403018c',uuid=9b9424a3-3053-4b8f-9eb9-5c81944a8fd5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "094f0848-c129-4499-8781-6943982188b6", "address": "fa:16:3e:44:2f:52", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094f0848-c1", "ovs_interfaceid": "094f0848-c129-4499-8781-6943982188b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converting VIF {"id": "094f0848-c129-4499-8781-6943982188b6", "address": "fa:16:3e:44:2f:52", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap094f0848-c1", "ovs_interfaceid": "094f0848-c129-4499-8781-6943982188b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:2f:52,bridge_name='br-int',has_traffic_filtering=True,id=094f0848-c129-4499-8781-6943982188b6,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094f0848-c1') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_vif [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:2f:52,bridge_name='br-int',has_traffic_filtering=True,id=094f0848-c129-4499-8781-6943982188b6,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094f0848-c1') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap094f0848-c1, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11945ddb-1ee6-47ce-9ce5-6765c434de70) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:31:16 user nova-compute[75293]: INFO os_vif [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:2f:52,bridge_name='br-int',has_traffic_filtering=True,id=094f0848-c129-4499-8781-6943982188b6,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap094f0848-c1')
Nov 30 07:31:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlBbPIwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:31:16 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8faf9a5-66c2-4963-8318-b525cc0b81cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:31:16 user nova-compute[75293]: No targets found.
Nov 30 07:31:16 user nova-compute[75293]: iSNS:
Nov 30 07:31:16 user nova-compute[75293]: No targets found.
Nov 30 07:31:16 user nova-compute[75293]: STATIC:
Nov 30 07:31:16 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff
Nov 30 07:31:16 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:31:16 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:31:16 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d
Nov 30 07:31:16 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:31:16 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:31:16 user nova-compute[75293]: FIRMWARE:
Nov 30 07:31:16 user nova-compute[75293]: No targets found.
Nov 30 07:31:16 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:31:16 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:31:16 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4920bf37-6aba-4cbc-a5d5-8153e4ddbe00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e61dcd-729f-4aec-9ef9-af9de78b09eb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:31:16 user nova-compute[75293]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff (non-flash)
Nov 30 07:31:16 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d (non-flash)
Nov 30 07:31:16 user nova-compute[75293]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff (non-flash)
Nov 30 07:31:16 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effebe20790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d'): ({'sdd'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Removing single pathed devices sdd {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf36028-f357-4a39-9f96-670b1a958e13]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d1900e-7176-435f-848f-633f0dc130fd]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Flushing IO for device /dev/sdd {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdaa1396-dcbd-44e0-be8a-f6f2d53df5a3]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[418a6a09-cd57-4e8f-aafa-03e7de34c4a0]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] SCSI volumes sdd have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff410bd-dc67-424b-87ef-986100338a45]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[da36b28a-1ec9-4688-a1cb-7a176ec85575]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d, portal: 172.16.0.220,3260]
Nov 30 07:31:16 user nova-compute[75293]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d, portal: 172.16.0.220,3260] successful.
Nov 30 07:31:16 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2b68185-3fc6-4d60-b764-b8c4cb3ce54d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3280aa-6790-4455-9d15-72675c993bc5]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] <== disconnect_volume: return (295ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:31:16 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Deleting instance files /opt/stack/data/nova/instances/9b9424a3-3053-4b8f-9eb9-5c81944a8fd5_del
Nov 30 07:31:16 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Deletion of /opt/stack/data/nova/instances/9b9424a3-3053-4b8f-9eb9-5c81944a8fd5_del complete
Nov 30 07:31:16 user nova-compute[75293]: INFO nova.compute.manager [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 30 07:31:16 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:31:16 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:31:17 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Took 0.53 seconds to deallocate network for instance.
Nov 30 07:31:17 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:31:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-004f11bc-3d97-4e70-b57f-16b13d817d21 req-a670cc71-30fe-40c5-b9b5-d34b4d4cd982 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received event network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:31:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-004f11bc-3d97-4e70-b57f-16b13d817d21 req-a670cc71-30fe-40c5-b9b5-d34b4d4cd982 service nova] Acquiring lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-004f11bc-3d97-4e70-b57f-16b13d817d21 req-a670cc71-30fe-40c5-b9b5-d34b4d4cd982 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-004f11bc-3d97-4e70-b57f-16b13d817d21 req-a670cc71-30fe-40c5-b9b5-d34b4d4cd982 service nova] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-004f11bc-3d97-4e70-b57f-16b13d817d21 req-a670cc71-30fe-40c5-b9b5-d34b4d4cd982 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] No waiting events found dispatching network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:31:17 user nova-compute[75293]: WARNING nova.compute.manager [req-004f11bc-3d97-4e70-b57f-16b13d817d21 req-a670cc71-30fe-40c5-b9b5-d34b4d4cd982 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received unexpected event network-vif-plugged-094f0848-c129-4499-8781-6943982188b6 for instance with vm_state active and task_state deleting.
Nov 30 07:31:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-004f11bc-3d97-4e70-b57f-16b13d817d21 req-a670cc71-30fe-40c5-b9b5-d34b4d4cd982 service nova] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Received event network-vif-deleted-094f0848-c129-4499-8781-6943982188b6 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:31:17 user nova-compute[75293]: INFO nova.compute.manager [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5] Took 0.76 seconds to detach 1 volumes for instance.
Nov 30 07:31:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:17 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:31:18 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:31:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:18 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Deleted allocations for instance 9b9424a3-3053-4b8f-9eb9-5c81944a8fd5
Nov 30 07:31:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-0b93e000-f2e7-4847-9748-e7d068e36634 tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "9b9424a3-3053-4b8f-9eb9-5c81944a8fd5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.840s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:23 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:25 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Acquiring lock "23bca083-fc9b-439b-9c5d-463c1187a5d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "23bca083-fc9b-439b-9c5d-463c1187a5d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:26 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:31:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:26 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:26 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:31:26 user nova-compute[75293]: INFO nova.compute.claims [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Claim successful on node user
Nov 30 07:31:27 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:31:27 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:31:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG nova.policy [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e97f2831a354c31a5c8b442a430e532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cd858197104635b10bf4248933da5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:31:27 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Creating image(s)
Nov 30 07:31:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Acquiring lock "/opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "/opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "/opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.180s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Acquiring lock "19f93a6a-cff3-412a-aefa-85d45ce86132" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "19f93a6a-cff3-412a-aefa-85d45ce86132" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG nova.compute.manager [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.187s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:31:27 user nova-compute[75293]: INFO nova.compute.claims [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Claim successful on node user
Nov 30 07:31:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk 1073741824" returned: 0 in 0.055s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:27 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Successfully created port: 98525ae2-e80f-4cb1-a222-426e315e26d1 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.177s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.compute.manager [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Cannot resize image /opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Ensure instance console log exists: /opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.compute.manager [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.network.neutron [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:31:28 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.compute.manager [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.policy [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e97f2831a354c31a5c8b442a430e532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cd858197104635b10bf4248933da5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.compute.manager [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:31:28 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Creating image(s)
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Acquiring lock "/opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "/opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "/opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Successfully updated port: 98525ae2-e80f-4cb1-a222-426e315e26d1 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.184s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.compute.manager [req-d80bcc4f-ccff-4642-9021-56b8c706eca4 req-d99b90b2-8dfa-4b54-ae87-2f6734ac7c92 service nova] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Received event network-changed-98525ae2-e80f-4cb1-a222-426e315e26d1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.compute.manager [req-d80bcc4f-ccff-4642-9021-56b8c706eca4 req-d99b90b2-8dfa-4b54-ae87-2f6734ac7c92 service nova] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Refreshing instance network info cache due to event network-changed-98525ae2-e80f-4cb1-a222-426e315e26d1. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d80bcc4f-ccff-4642-9021-56b8c706eca4 req-d99b90b2-8dfa-4b54-ae87-2f6734ac7c92 service nova] Acquiring lock "refresh_cache-23bca083-fc9b-439b-9c5d-463c1187a5d5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d80bcc4f-ccff-4642-9021-56b8c706eca4 req-d99b90b2-8dfa-4b54-ae87-2f6734ac7c92 service nova] Acquired lock "refresh_cache-23bca083-fc9b-439b-9c5d-463c1187a5d5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.network.neutron [req-d80bcc4f-ccff-4642-9021-56b8c706eca4 req-d99b90b2-8dfa-4b54-ae87-2f6734ac7c92 service nova] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Refreshing network info cache for port 98525ae2-e80f-4cb1-a222-426e315e26d1 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Acquiring lock "refresh_cache-23bca083-fc9b-439b-9c5d-463c1187a5d5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.network.neutron [req-d80bcc4f-ccff-4642-9021-56b8c706eca4 req-d99b90b2-8dfa-4b54-ae87-2f6734ac7c92 service nova] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.174s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk 1073741824" returned: 0 in 0.049s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.network.neutron [req-d80bcc4f-ccff-4642-9021-56b8c706eca4 req-d99b90b2-8dfa-4b54-ae87-2f6734ac7c92 service nova] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d80bcc4f-ccff-4642-9021-56b8c706eca4 req-d99b90b2-8dfa-4b54-ae87-2f6734ac7c92 service nova] Releasing lock "refresh_cache-23bca083-fc9b-439b-9c5d-463c1187a5d5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Acquired lock "refresh_cache-23bca083-fc9b-439b-9c5d-463c1187a5d5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:31:28 user nova-compute[75293]: DEBUG nova.network.neutron [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Successfully created port: f788a7f8-c72b-45a6-b533-bba0a990e17a {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.186s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Checking if we can resize image /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Cannot resize image /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Ensure instance console log exists: /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.network.neutron [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Updating instance_info_cache with network_info: [{"id": "98525ae2-e80f-4cb1-a222-426e315e26d1", "address": "fa:16:3e:92:8f:c2", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98525ae2-e8", "ovs_interfaceid": "98525ae2-e80f-4cb1-a222-426e315e26d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Releasing lock "refresh_cache-23bca083-fc9b-439b-9c5d-463c1187a5d5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Instance network_info: |[{"id": "98525ae2-e80f-4cb1-a222-426e315e26d1", "address": "fa:16:3e:92:8f:c2", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98525ae2-e8", "ovs_interfaceid": "98525ae2-e80f-4cb1-a222-426e315e26d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Start _get_guest_xml network_info=[{"id": "98525ae2-e80f-4cb1-a222-426e315e26d1", "address": "fa:16:3e:92:8f:c2", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98525ae2-e8", "ovs_interfaceid": "98525ae2-e80f-4cb1-a222-426e315e26d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:31:29 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:31:29 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:31:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1174822950',display_name='tempest-ServerRescueNegativeTestJSON-server-1174822950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1174822950',id=45,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66cd858197104635b10bf4248933da5a',ramdisk_id='',reservation_id='r-glukcayn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1533256171',owner_user_name='tempest-ServerRescueNegativeTestJSON-1533256171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:31:27Z,user_data=None,user_id='8e97f2831a354c31a5c8b442a430e532',uuid=23bca083-fc9b-439b-9c5d-463c1187a5d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98525ae2-e80f-4cb1-a222-426e315e26d1", "address": "fa:16:3e:92:8f:c2", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98525ae2-e8", "ovs_interfaceid": "98525ae2-e80f-4cb1-a222-426e315e26d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Converting VIF {"id": "98525ae2-e80f-4cb1-a222-426e315e26d1", "address": "fa:16:3e:92:8f:c2", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98525ae2-e8", "ovs_interfaceid": "98525ae2-e80f-4cb1-a222-426e315e26d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8f:c2,bridge_name='br-int',has_traffic_filtering=True,id=98525ae2-e80f-4cb1-a222-426e315e26d1,network=Network(889053dd-4bc3-435c-ac9f-751c7086044a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98525ae2-e8') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.objects.instance [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lazy-loading 'pci_devices' on Instance uuid 23bca083-fc9b-439b-9c5d-463c1187a5d5 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:31:29 user nova-compute[75293]:   <uuid>23bca083-fc9b-439b-9c5d-463c1187a5d5</uuid>
Nov 30 07:31:29 user nova-compute[75293]:   <name>instance-0000002d</name>
Nov 30 07:31:29 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:31:29 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:31:29 user nova-compute[75293]:   <metadata>
Nov 30 07:31:29 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:31:29 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:31:29 user nova-compute[75293]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1174822950</nova:name>
Nov 30 07:31:29 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:31:29</nova:creationTime>
Nov 30 07:31:29 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:31:29 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:31:29 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:31:29 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:31:29 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:31:29 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:31:29 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:31:29 user nova-compute[75293]:       <nova:owner>
Nov 30 07:31:29 user nova-compute[75293]:         <nova:user uuid="8e97f2831a354c31a5c8b442a430e532">tempest-ServerRescueNegativeTestJSON-1533256171-project-member</nova:user>
Nov 30 07:31:29 user nova-compute[75293]:         <nova:project uuid="66cd858197104635b10bf4248933da5a">tempest-ServerRescueNegativeTestJSON-1533256171</nova:project>
Nov 30 07:31:29 user nova-compute[75293]:       </nova:owner>
Nov 30 07:31:29 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:31:29 user nova-compute[75293]:       <nova:ports>
Nov 30 07:31:29 user nova-compute[75293]:         <nova:port uuid="98525ae2-e80f-4cb1-a222-426e315e26d1">
Nov 30 07:31:29 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 30 07:31:29 user nova-compute[75293]:         </nova:port>
Nov 30 07:31:29 user nova-compute[75293]:       </nova:ports>
Nov 30 07:31:29 user nova-compute[75293]:     </nova:instance>
Nov 30 07:31:29 user nova-compute[75293]:   </metadata>
Nov 30 07:31:29 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:31:29 user nova-compute[75293]:     <system>
Nov 30 07:31:29 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:31:29 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:31:29 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:31:29 user nova-compute[75293]:       <entry name="serial">23bca083-fc9b-439b-9c5d-463c1187a5d5</entry>
Nov 30 07:31:29 user nova-compute[75293]:       <entry name="uuid">23bca083-fc9b-439b-9c5d-463c1187a5d5</entry>
Nov 30 07:31:29 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:31:29 user nova-compute[75293]:     </system>
Nov 30 07:31:29 user nova-compute[75293]:   </sysinfo>
Nov 30 07:31:29 user nova-compute[75293]:   <os>
Nov 30 07:31:29 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:31:29 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:31:29 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:31:29 user nova-compute[75293]:   </os>
Nov 30 07:31:29 user nova-compute[75293]:   <features>
Nov 30 07:31:29 user nova-compute[75293]:     <acpi/>
Nov 30 07:31:29 user nova-compute[75293]:     <apic/>
Nov 30 07:31:29 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:31:29 user nova-compute[75293]:   </features>
Nov 30 07:31:29 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:31:29 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:31:29 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:31:29 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:31:29 user nova-compute[75293]:   </clock>
Nov 30 07:31:29 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:31:29 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:31:29 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:31:29 user nova-compute[75293]:   </cpu>
Nov 30 07:31:29 user nova-compute[75293]:   <devices>
Nov 30 07:31:29 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:31:29 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:31:29 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk"/>
Nov 30 07:31:29 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:31:29 user nova-compute[75293]:     </disk>
Nov 30 07:31:29 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:31:29 user nova-compute[75293]:       <mac address="fa:16:3e:92:8f:c2"/>
Nov 30 07:31:29 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:31:29 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:31:29 user nova-compute[75293]:       <target dev="tap98525ae2-e8"/>
Nov 30 07:31:29 user nova-compute[75293]:     </interface>
Nov 30 07:31:29 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:31:29 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/console.log" append="off"/>
Nov 30 07:31:29 user nova-compute[75293]:     </serial>
Nov 30 07:31:29 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:31:29 user nova-compute[75293]:     <video>
Nov 30 07:31:29 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:31:29 user nova-compute[75293]:     </video>
Nov 30 07:31:29 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:31:29 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:31:29 user nova-compute[75293]:     </rng>
Nov 30 07:31:29 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:31:29 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:31:29 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:31:29 user nova-compute[75293]:     </memballoon>
Nov 30 07:31:29 user nova-compute[75293]:   </devices>
Nov 30 07:31:29 user nova-compute[75293]: </domain>
Nov 30 07:31:29 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:31:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1174822950',display_name='tempest-ServerRescueNegativeTestJSON-server-1174822950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1174822950',id=45,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66cd858197104635b10bf4248933da5a',ramdisk_id='',reservation_id='r-glukcayn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1533256171',owner_user_name='tempest-ServerRescueNegativeTestJSON-1533256171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:31:27Z,user_data=None,user_id='8e97f2831a354c31a5c8b442a430e532',uuid=23bca083-fc9b-439b-9c5d-463c1187a5d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98525ae2-e80f-4cb1-a222-426e315e26d1", "address": "fa:16:3e:92:8f:c2", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98525ae2-e8", "ovs_interfaceid": "98525ae2-e80f-4cb1-a222-426e315e26d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Converting VIF {"id": "98525ae2-e80f-4cb1-a222-426e315e26d1", "address": "fa:16:3e:92:8f:c2", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98525ae2-e8", "ovs_interfaceid": "98525ae2-e80f-4cb1-a222-426e315e26d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8f:c2,bridge_name='br-int',has_traffic_filtering=True,id=98525ae2-e80f-4cb1-a222-426e315e26d1,network=Network(889053dd-4bc3-435c-ac9f-751c7086044a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98525ae2-e8') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG os_vif [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8f:c2,bridge_name='br-int',has_traffic_filtering=True,id=98525ae2-e80f-4cb1-a222-426e315e26d1,network=Network(889053dd-4bc3-435c-ac9f-751c7086044a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98525ae2-e8') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4d58b4e-895c-548b-8ad4-092604fd0512', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98525ae2-e8, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98525ae2-e8, col_values=(('qos', UUID('7fe4b779-be40-4cdf-b4ce-fdb12856f09e')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98525ae2-e8, col_values=(('external_ids', {'iface-id': '98525ae2-e80f-4cb1-a222-426e315e26d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:8f:c2', 'vm-uuid': '23bca083-fc9b-439b-9c5d-463c1187a5d5'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:29 user nova-compute[75293]: INFO os_vif [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8f:c2,bridge_name='br-int',has_traffic_filtering=True,id=98525ae2-e80f-4cb1-a222-426e315e26d1,network=Network(889053dd-4bc3-435c-ac9f-751c7086044a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98525ae2-e8')
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] No VIF found with MAC fa:16:3e:92:8f:c2, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.network.neutron [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Successfully updated port: f788a7f8-c72b-45a6-b533-bba0a990e17a {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Acquiring lock "refresh_cache-19f93a6a-cff3-412a-aefa-85d45ce86132" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Acquired lock "refresh_cache-19f93a6a-cff3-412a-aefa-85d45ce86132" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.network.neutron [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-133a7fb8-f458-4421-97d4-327dc80cdde8 req-54de78ab-810c-44cc-8760-72a94942a9c4 service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Received event network-changed-f788a7f8-c72b-45a6-b533-bba0a990e17a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-133a7fb8-f458-4421-97d4-327dc80cdde8 req-54de78ab-810c-44cc-8760-72a94942a9c4 service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Refreshing instance network info cache due to event network-changed-f788a7f8-c72b-45a6-b533-bba0a990e17a. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-133a7fb8-f458-4421-97d4-327dc80cdde8 req-54de78ab-810c-44cc-8760-72a94942a9c4 service nova] Acquiring lock "refresh_cache-19f93a6a-cff3-412a-aefa-85d45ce86132" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:31:29 user nova-compute[75293]: DEBUG nova.network.neutron [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.network.neutron [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Updating instance_info_cache with network_info: [{"id": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "address": "fa:16:3e:66:a7:3e", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf788a7f8-c7", "ovs_interfaceid": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Releasing lock "refresh_cache-19f93a6a-cff3-412a-aefa-85d45ce86132" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.compute.manager [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Instance network_info: |[{"id": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "address": "fa:16:3e:66:a7:3e", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf788a7f8-c7", "ovs_interfaceid": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-133a7fb8-f458-4421-97d4-327dc80cdde8 req-54de78ab-810c-44cc-8760-72a94942a9c4 service nova] Acquired lock "refresh_cache-19f93a6a-cff3-412a-aefa-85d45ce86132" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.network.neutron [req-133a7fb8-f458-4421-97d4-327dc80cdde8 req-54de78ab-810c-44cc-8760-72a94942a9c4 service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Refreshing network info cache for port f788a7f8-c72b-45a6-b533-bba0a990e17a {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Start _get_guest_xml network_info=[{"id": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "address": "fa:16:3e:66:a7:3e", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf788a7f8-c7", "ovs_interfaceid": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:31:30 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:31:30 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:31:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2108958473',display_name='tempest-ServerRescueNegativeTestJSON-server-2108958473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2108958473',id=46,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66cd858197104635b10bf4248933da5a',ramdisk_id='',reservation_id='r-0fx8bm00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1533256171',owner_user_name='tempest-ServerRescueNegativeTestJSON-1533256171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:31:28Z,user_data=None,user_id='8e97f2831a354c31a5c8b442a430e532',uuid=19f93a6a-cff3-412a-aefa-85d45ce86132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "address": "fa:16:3e:66:a7:3e", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf788a7f8-c7", "ovs_interfaceid": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Converting VIF {"id": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "address": "fa:16:3e:66:a7:3e", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf788a7f8-c7", "ovs_interfaceid": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:a7:3e,bridge_name='br-int',has_traffic_filtering=True,id=f788a7f8-c72b-45a6-b533-bba0a990e17a,network=Network(889053dd-4bc3-435c-ac9f-751c7086044a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf788a7f8-c7') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.objects.instance [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lazy-loading 'pci_devices' on Instance uuid 19f93a6a-cff3-412a-aefa-85d45ce86132 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:31:30 user nova-compute[75293]:   <uuid>19f93a6a-cff3-412a-aefa-85d45ce86132</uuid>
Nov 30 07:31:30 user nova-compute[75293]:   <name>instance-0000002e</name>
Nov 30 07:31:30 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:31:30 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:31:30 user nova-compute[75293]:   <metadata>
Nov 30 07:31:30 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:31:30 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:31:30 user nova-compute[75293]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2108958473</nova:name>
Nov 30 07:31:30 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:31:30</nova:creationTime>
Nov 30 07:31:30 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:31:30 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:31:30 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:31:30 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:31:30 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:31:30 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:31:30 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:31:30 user nova-compute[75293]:       <nova:owner>
Nov 30 07:31:30 user nova-compute[75293]:         <nova:user uuid="8e97f2831a354c31a5c8b442a430e532">tempest-ServerRescueNegativeTestJSON-1533256171-project-member</nova:user>
Nov 30 07:31:30 user nova-compute[75293]:         <nova:project uuid="66cd858197104635b10bf4248933da5a">tempest-ServerRescueNegativeTestJSON-1533256171</nova:project>
Nov 30 07:31:30 user nova-compute[75293]:       </nova:owner>
Nov 30 07:31:30 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:31:30 user nova-compute[75293]:       <nova:ports>
Nov 30 07:31:30 user nova-compute[75293]:         <nova:port uuid="f788a7f8-c72b-45a6-b533-bba0a990e17a">
Nov 30 07:31:30 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 07:31:30 user nova-compute[75293]:         </nova:port>
Nov 30 07:31:30 user nova-compute[75293]:       </nova:ports>
Nov 30 07:31:30 user nova-compute[75293]:     </nova:instance>
Nov 30 07:31:30 user nova-compute[75293]:   </metadata>
Nov 30 07:31:30 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:31:30 user nova-compute[75293]:     <system>
Nov 30 07:31:30 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:31:30 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:31:30 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:31:30 user nova-compute[75293]:       <entry name="serial">19f93a6a-cff3-412a-aefa-85d45ce86132</entry>
Nov 30 07:31:30 user nova-compute[75293]:       <entry name="uuid">19f93a6a-cff3-412a-aefa-85d45ce86132</entry>
Nov 30 07:31:30 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:31:30 user nova-compute[75293]:     </system>
Nov 30 07:31:30 user nova-compute[75293]:   </sysinfo>
Nov 30 07:31:30 user nova-compute[75293]:   <os>
Nov 30 07:31:30 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:31:30 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:31:30 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:31:30 user nova-compute[75293]:   </os>
Nov 30 07:31:30 user nova-compute[75293]:   <features>
Nov 30 07:31:30 user nova-compute[75293]:     <acpi/>
Nov 30 07:31:30 user nova-compute[75293]:     <apic/>
Nov 30 07:31:30 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:31:30 user nova-compute[75293]:   </features>
Nov 30 07:31:30 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:31:30 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:31:30 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:31:30 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:31:30 user nova-compute[75293]:   </clock>
Nov 30 07:31:30 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:31:30 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:31:30 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:31:30 user nova-compute[75293]:   </cpu>
Nov 30 07:31:30 user nova-compute[75293]:   <devices>
Nov 30 07:31:30 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:31:30 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:31:30 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk"/>
Nov 30 07:31:30 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:31:30 user nova-compute[75293]:     </disk>
Nov 30 07:31:30 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:31:30 user nova-compute[75293]:       <mac address="fa:16:3e:66:a7:3e"/>
Nov 30 07:31:30 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:31:30 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:31:30 user nova-compute[75293]:       <target dev="tapf788a7f8-c7"/>
Nov 30 07:31:30 user nova-compute[75293]:     </interface>
Nov 30 07:31:30 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:31:30 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/console.log" append="off"/>
Nov 30 07:31:30 user nova-compute[75293]:     </serial>
Nov 30 07:31:30 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:31:30 user nova-compute[75293]:     <video>
Nov 30 07:31:30 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:31:30 user nova-compute[75293]:     </video>
Nov 30 07:31:30 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:31:30 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:31:30 user nova-compute[75293]:     </rng>
Nov 30 07:31:30 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:31:30 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:31:30 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:31:30 user nova-compute[75293]:     </memballoon>
Nov 30 07:31:30 user nova-compute[75293]:   </devices>
Nov 30 07:31:30 user nova-compute[75293]: </domain>
Nov 30 07:31:30 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:31:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2108958473',display_name='tempest-ServerRescueNegativeTestJSON-server-2108958473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2108958473',id=46,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66cd858197104635b10bf4248933da5a',ramdisk_id='',reservation_id='r-0fx8bm00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1533256171',owner_user_name='tempest-ServerRescueNegativeTestJSON-1533256171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:31:28Z,user_data=None,user_id='8e97f2831a354c31a5c8b442a430e532',uuid=19f93a6a-cff3-412a-aefa-85d45ce86132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "address": "fa:16:3e:66:a7:3e", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf788a7f8-c7", "ovs_interfaceid": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Converting VIF {"id": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "address": "fa:16:3e:66:a7:3e", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf788a7f8-c7", "ovs_interfaceid": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:a7:3e,bridge_name='br-int',has_traffic_filtering=True,id=f788a7f8-c72b-45a6-b533-bba0a990e17a,network=Network(889053dd-4bc3-435c-ac9f-751c7086044a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf788a7f8-c7') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG os_vif [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:a7:3e,bridge_name='br-int',has_traffic_filtering=True,id=f788a7f8-c72b-45a6-b533-bba0a990e17a,network=Network(889053dd-4bc3-435c-ac9f-751c7086044a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf788a7f8-c7') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a43c3d59-63c0-5465-af5a-9552049f67c0', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf788a7f8-c7, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf788a7f8-c7, col_values=(('qos', UUID('ac105bb9-ada6-4c01-ad64-aa7e20c9aa31')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf788a7f8-c7, col_values=(('external_ids', {'iface-id': 'f788a7f8-c72b-45a6-b533-bba0a990e17a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:a7:3e', 'vm-uuid': '19f93a6a-cff3-412a-aefa-85d45ce86132'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:30 user nova-compute[75293]: INFO os_vif [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:a7:3e,bridge_name='br-int',has_traffic_filtering=True,id=f788a7f8-c72b-45a6-b533-bba0a990e17a,network=Network(889053dd-4bc3-435c-ac9f-751c7086044a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf788a7f8-c7')
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] No VIF found with MAC fa:16:3e:66:a7:3e, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.network.neutron [req-133a7fb8-f458-4421-97d4-327dc80cdde8 req-54de78ab-810c-44cc-8760-72a94942a9c4 service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Updated VIF entry in instance network info cache for port f788a7f8-c72b-45a6-b533-bba0a990e17a. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.network.neutron [req-133a7fb8-f458-4421-97d4-327dc80cdde8 req-54de78ab-810c-44cc-8760-72a94942a9c4 service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Updating instance_info_cache with network_info: [{"id": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "address": "fa:16:3e:66:a7:3e", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf788a7f8-c7", "ovs_interfaceid": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-133a7fb8-f458-4421-97d4-327dc80cdde8 req-54de78ab-810c-44cc-8760-72a94942a9c4 service nova] Releasing lock "refresh_cache-19f93a6a-cff3-412a-aefa-85d45ce86132" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-a33d29b6-2fb0-4506-8772-a995402c35d3 req-78593937-99f4-4ba3-a1c5-b441b09771f8 service nova] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Received event network-vif-plugged-98525ae2-e80f-4cb1-a222-426e315e26d1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a33d29b6-2fb0-4506-8772-a995402c35d3 req-78593937-99f4-4ba3-a1c5-b441b09771f8 service nova] Acquiring lock "23bca083-fc9b-439b-9c5d-463c1187a5d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a33d29b6-2fb0-4506-8772-a995402c35d3 req-78593937-99f4-4ba3-a1c5-b441b09771f8 service nova] Lock "23bca083-fc9b-439b-9c5d-463c1187a5d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-a33d29b6-2fb0-4506-8772-a995402c35d3 req-78593937-99f4-4ba3-a1c5-b441b09771f8 service nova] Lock "23bca083-fc9b-439b-9c5d-463c1187a5d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:30 user nova-compute[75293]: DEBUG nova.compute.manager [req-a33d29b6-2fb0-4506-8772-a995402c35d3 req-78593937-99f4-4ba3-a1c5-b441b09771f8 service nova] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] No waiting events found dispatching network-vif-plugged-98525ae2-e80f-4cb1-a222-426e315e26d1 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:31:30 user nova-compute[75293]: WARNING nova.compute.manager [req-a33d29b6-2fb0-4506-8772-a995402c35d3 req-78593937-99f4-4ba3-a1c5-b441b09771f8 service nova] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Received unexpected event network-vif-plugged-98525ae2-e80f-4cb1-a222-426e315e26d1 for instance with vm_state building and task_state spawning.
Nov 30 07:31:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-5ce7cc91-ce6a-4a61-882a-f4ae9d7cf753 req-4a394d62-9e1b-4b99-bf82-336795171d99 service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Received event network-vif-plugged-f788a7f8-c72b-45a6-b533-bba0a990e17a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:31:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5ce7cc91-ce6a-4a61-882a-f4ae9d7cf753 req-4a394d62-9e1b-4b99-bf82-336795171d99 service nova] Acquiring lock "19f93a6a-cff3-412a-aefa-85d45ce86132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5ce7cc91-ce6a-4a61-882a-f4ae9d7cf753 req-4a394d62-9e1b-4b99-bf82-336795171d99 service nova] Lock "19f93a6a-cff3-412a-aefa-85d45ce86132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5ce7cc91-ce6a-4a61-882a-f4ae9d7cf753 req-4a394d62-9e1b-4b99-bf82-336795171d99 service nova] Lock "19f93a6a-cff3-412a-aefa-85d45ce86132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-5ce7cc91-ce6a-4a61-882a-f4ae9d7cf753 req-4a394d62-9e1b-4b99-bf82-336795171d99 service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] No waiting events found dispatching network-vif-plugged-f788a7f8-c72b-45a6-b533-bba0a990e17a {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:31:32 user nova-compute[75293]: WARNING nova.compute.manager [req-5ce7cc91-ce6a-4a61-882a-f4ae9d7cf753 req-4a394d62-9e1b-4b99-bf82-336795171d99 service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Received unexpected event network-vif-plugged-f788a7f8-c72b-45a6-b533-bba0a990e17a for instance with vm_state building and task_state spawning.
Nov 30 07:31:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-55f48e67-16f4-4975-b950-5638d2be60d9 req-7899c893-a5ac-4b28-865c-6204e74ab520 service nova] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Received event network-vif-plugged-98525ae2-e80f-4cb1-a222-426e315e26d1 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:31:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-55f48e67-16f4-4975-b950-5638d2be60d9 req-7899c893-a5ac-4b28-865c-6204e74ab520 service nova] Acquiring lock "23bca083-fc9b-439b-9c5d-463c1187a5d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-55f48e67-16f4-4975-b950-5638d2be60d9 req-7899c893-a5ac-4b28-865c-6204e74ab520 service nova] Lock "23bca083-fc9b-439b-9c5d-463c1187a5d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:32 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-55f48e67-16f4-4975-b950-5638d2be60d9 req-7899c893-a5ac-4b28-865c-6204e74ab520 service nova] Lock "23bca083-fc9b-439b-9c5d-463c1187a5d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:32 user nova-compute[75293]: DEBUG nova.compute.manager [req-55f48e67-16f4-4975-b950-5638d2be60d9 req-7899c893-a5ac-4b28-865c-6204e74ab520 service nova] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] No waiting events found dispatching network-vif-plugged-98525ae2-e80f-4cb1-a222-426e315e26d1 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:31:32 user nova-compute[75293]: WARNING nova.compute.manager [req-55f48e67-16f4-4975-b950-5638d2be60d9 req-7899c893-a5ac-4b28-865c-6204e74ab520 service nova] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Received unexpected event network-vif-plugged-98525ae2-e80f-4cb1-a222-426e315e26d1 for instance with vm_state building and task_state spawning.
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:31:34 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Instance spawned successfully.
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:31:34 user nova-compute[75293]: INFO nova.compute.manager [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Took 6.78 seconds to spawn the instance on the hypervisor.
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.compute.manager [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:31:34 user nova-compute[75293]: INFO nova.compute.manager [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Took 7.37 seconds to build instance.
Nov 30 07:31:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-ccbdd6c5-7c5b-4ba9-8f76-0e28efb3965d tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "23bca083-fc9b-439b-9c5d-463c1187a5d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.465s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.compute.manager [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:31:34 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Instance spawned successfully.
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:31:34 user nova-compute[75293]: INFO nova.compute.manager [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Took 6.21 seconds to spawn the instance on the hypervisor.
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.compute.manager [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.compute.manager [req-ea65cc6e-9f77-4c83-abae-a7ebe7c2c078 req-4ee9fab4-461c-4659-8599-1749290acf55 service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Received event network-vif-plugged-f788a7f8-c72b-45a6-b533-bba0a990e17a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ea65cc6e-9f77-4c83-abae-a7ebe7c2c078 req-4ee9fab4-461c-4659-8599-1749290acf55 service nova] Acquiring lock "19f93a6a-cff3-412a-aefa-85d45ce86132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ea65cc6e-9f77-4c83-abae-a7ebe7c2c078 req-4ee9fab4-461c-4659-8599-1749290acf55 service nova] Lock "19f93a6a-cff3-412a-aefa-85d45ce86132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-ea65cc6e-9f77-4c83-abae-a7ebe7c2c078 req-4ee9fab4-461c-4659-8599-1749290acf55 service nova] Lock "19f93a6a-cff3-412a-aefa-85d45ce86132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:34 user nova-compute[75293]: DEBUG nova.compute.manager [req-ea65cc6e-9f77-4c83-abae-a7ebe7c2c078 req-4ee9fab4-461c-4659-8599-1749290acf55 service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] No waiting events found dispatching network-vif-plugged-f788a7f8-c72b-45a6-b533-bba0a990e17a {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:31:34 user nova-compute[75293]: WARNING nova.compute.manager [req-ea65cc6e-9f77-4c83-abae-a7ebe7c2c078 req-4ee9fab4-461c-4659-8599-1749290acf55 service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Received unexpected event network-vif-plugged-f788a7f8-c72b-45a6-b533-bba0a990e17a for instance with vm_state building and task_state spawning.
Nov 30 07:31:34 user nova-compute[75293]: INFO nova.compute.manager [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Took 6.90 seconds to build instance.
Nov 30 07:31:34 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5af403a5-7967-4923-992d-78b18cc77170 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "19f93a6a-cff3-412a-aefa-85d45ce86132" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.997s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:31:35 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:40 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:45 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:50 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:55 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:31:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:00 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:03 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:32:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:32:04 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:32:05 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:05 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:32:05 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:32:06 user nova-compute[75293]: INFO nova.compute.manager [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Terminating instance
Nov 30 07:32:06 user nova-compute[75293]: DEBUG nova.compute.manager [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-b8fcffcf-968b-465f-809f-c3ad15c6ad02 req-0a3cd732-89d7-4657-a4ad-b9d2fce09ae3 service nova] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Received event network-vif-unplugged-66299713-0237-47db-9fef-e5816beed9d9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b8fcffcf-968b-465f-809f-c3ad15c6ad02 req-0a3cd732-89d7-4657-a4ad-b9d2fce09ae3 service nova] Acquiring lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b8fcffcf-968b-465f-809f-c3ad15c6ad02 req-0a3cd732-89d7-4657-a4ad-b9d2fce09ae3 service nova] Lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-b8fcffcf-968b-465f-809f-c3ad15c6ad02 req-0a3cd732-89d7-4657-a4ad-b9d2fce09ae3 service nova] Lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-b8fcffcf-968b-465f-809f-c3ad15c6ad02 req-0a3cd732-89d7-4657-a4ad-b9d2fce09ae3 service nova] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] No waiting events found dispatching network-vif-unplugged-66299713-0237-47db-9fef-e5816beed9d9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG nova.compute.manager [req-b8fcffcf-968b-465f-809f-c3ad15c6ad02 req-0a3cd732-89d7-4657-a4ad-b9d2fce09ae3 service nova] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Received event network-vif-unplugged-66299713-0237-47db-9fef-e5816beed9d9 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:06 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Instance destroyed successfully.
Nov 30 07:32:06 user nova-compute[75293]: DEBUG nova.objects.instance [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lazy-loading 'resources' on Instance uuid c8d1df78-2aa2-4710-a570-5f72c60cfc26 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-399307917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-399307917',id=16,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:12:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f09e4044dadb4f2aa0d29f35f23008d2',ramdisk_id='',reservation_id='r-i5oahpg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:14:26Z,user_data=None,user_id='83119c1bbe4142a086680a113403018c',uuid=c8d1df78-2aa2-4710-a570-5f72c60cfc26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66299713-0237-47db-9fef-e5816beed9d9", "address": "fa:16:3e:db:c2:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66299713-02", "ovs_interfaceid": "66299713-0237-47db-9fef-e5816beed9d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converting VIF {"id": "66299713-0237-47db-9fef-e5816beed9d9", "address": "fa:16:3e:db:c2:51", "network": {"id": "d178db15-a510-46f2-8c2d-2312155fb9c3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1580195010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f09e4044dadb4f2aa0d29f35f23008d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66299713-02", "ovs_interfaceid": "66299713-0237-47db-9fef-e5816beed9d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:c2:51,bridge_name='br-int',has_traffic_filtering=True,id=66299713-0237-47db-9fef-e5816beed9d9,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66299713-02') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG os_vif [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:c2:51,bridge_name='br-int',has_traffic_filtering=True,id=66299713-0237-47db-9fef-e5816beed9d9,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66299713-02') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66299713-02, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4dfb0d1e-8cac-4251-acb2-d52759399d8a) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:06 user nova-compute[75293]: INFO os_vif [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:c2:51,bridge_name='br-int',has_traffic_filtering=True,id=66299713-0237-47db-9fef-e5816beed9d9,network=Network(d178db15-a510-46f2-8c2d-2312155fb9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66299713-02')
Nov 30 07:32:06 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Deleting instance files /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26_del
Nov 30 07:32:06 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Deletion of /opt/stack/data/nova/instances/c8d1df78-2aa2-4710-a570-5f72c60cfc26_del complete
Nov 30 07:32:06 user nova-compute[75293]: INFO nova.compute.manager [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 30 07:32:06 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:32:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:07 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:32:07 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Took 0.39 seconds to deallocate network for instance.
Nov 30 07:32:07 user nova-compute[75293]: DEBUG nova.compute.manager [req-a45b52e4-3730-462a-a540-b4fa4d7c31d0 req-608ebf67-248b-4d39-a5fd-0e6717299c3f service nova] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Received event network-vif-deleted-66299713-0237-47db-9fef-e5816beed9d9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:32:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:32:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:32:07 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:32:07 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:32:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:32:07 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Deleted allocations for instance c8d1df78-2aa2-4710-a570-5f72c60cfc26
Nov 30 07:32:07 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-a6f2941d-29c1-4941-8796-f3c218e8271a tempest-ServerBootFromVolumeStableRescueTest-2053873633 tempest-ServerBootFromVolumeStableRescueTest-2053873633-project-member] Lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.472s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:32:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-5c76ccac-d9eb-45bb-ad20-88a698281190 req-b66d28f8-9fde-4411-b6f2-5940e98bc69a service nova] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Received event network-vif-plugged-66299713-0237-47db-9fef-e5816beed9d9 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:32:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5c76ccac-d9eb-45bb-ad20-88a698281190 req-b66d28f8-9fde-4411-b6f2-5940e98bc69a service nova] Acquiring lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:32:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5c76ccac-d9eb-45bb-ad20-88a698281190 req-b66d28f8-9fde-4411-b6f2-5940e98bc69a service nova] Lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:32:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-5c76ccac-d9eb-45bb-ad20-88a698281190 req-b66d28f8-9fde-4411-b6f2-5940e98bc69a service nova] Lock "c8d1df78-2aa2-4710-a570-5f72c60cfc26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:32:08 user nova-compute[75293]: DEBUG nova.compute.manager [req-5c76ccac-d9eb-45bb-ad20-88a698281190 req-b66d28f8-9fde-4411-b6f2-5940e98bc69a service nova] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] No waiting events found dispatching network-vif-plugged-66299713-0237-47db-9fef-e5816beed9d9 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:32:08 user nova-compute[75293]: WARNING nova.compute.manager [req-5c76ccac-d9eb-45bb-ad20-88a698281190 req-b66d28f8-9fde-4411-b6f2-5940e98bc69a service nova] [instance: c8d1df78-2aa2-4710-a570-5f72c60cfc26] Received unexpected event network-vif-plugged-66299713-0237-47db-9fef-e5816beed9d9 for instance with vm_state deleted and task_state None.
Nov 30 07:32:08 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:32:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:32:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:32:08 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:32:08 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:32:08 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:32:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:32:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:32:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:32:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:32:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:32:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:32:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:32:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:32:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:32:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:32:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:32:09 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:32:10 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:32:10 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:32:10 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=8446MB free_disk=25.068660736083984GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:32:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:32:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:32:10 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 3aeab623-a85f-44d7-9ada-15df4910d953 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:32:10 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 3e25b799-6205-4724-bffc-f36e93c1ca98 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:32:10 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 23bca083-fc9b-439b-9c5d-463c1187a5d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:32:10 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 19f93a6a-cff3-412a-aefa-85d45ce86132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:32:10 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:32:10 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:32:10 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:32:10 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:32:10 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:32:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:32:11 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:32:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:11 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:32:12 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:32:12 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:32:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-3aeab623-a85f-44d7-9ada-15df4910d953" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:32:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-3aeab623-a85f-44d7-9ada-15df4910d953" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:32:12 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:32:13 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Updating instance_info_cache with network_info: [{"id": "6b56baae-9530-49e2-a5b1-57474bac4edf", "address": "fa:16:3e:bf:8a:51", "network": {"id": "b9e6e49f-b3d6-4857-8043-636a22f30f91", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "552643428120431f8bbeadca55f077de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b56baae-95", "ovs_interfaceid": "6b56baae-9530-49e2-a5b1-57474bac4edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:32:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-3aeab623-a85f-44d7-9ada-15df4910d953" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:32:13 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:32:13 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:32:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:32:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Acquiring lock "3aeab623-a85f-44d7-9ada-15df4910d953" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:32:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Lock "3aeab623-a85f-44d7-9ada-15df4910d953" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:32:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Acquiring lock "3aeab623-a85f-44d7-9ada-15df4910d953-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:32:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Lock "3aeab623-a85f-44d7-9ada-15df4910d953-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:32:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Lock "3aeab623-a85f-44d7-9ada-15df4910d953-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:32:17 user nova-compute[75293]: INFO nova.compute.manager [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Terminating instance
Nov 30 07:32:17 user nova-compute[75293]: DEBUG nova.compute.manager [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:32:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-c03a344e-14b0-4433-a6a9-4b5f2c9dd9d5 req-4ee114d2-0fb2-4139-952b-9db7175add34 service nova] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Received event network-vif-unplugged-6b56baae-9530-49e2-a5b1-57474bac4edf {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:32:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c03a344e-14b0-4433-a6a9-4b5f2c9dd9d5 req-4ee114d2-0fb2-4139-952b-9db7175add34 service nova] Acquiring lock "3aeab623-a85f-44d7-9ada-15df4910d953-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:32:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c03a344e-14b0-4433-a6a9-4b5f2c9dd9d5 req-4ee114d2-0fb2-4139-952b-9db7175add34 service nova] Lock "3aeab623-a85f-44d7-9ada-15df4910d953-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:32:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c03a344e-14b0-4433-a6a9-4b5f2c9dd9d5 req-4ee114d2-0fb2-4139-952b-9db7175add34 service nova] Lock "3aeab623-a85f-44d7-9ada-15df4910d953-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:32:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-c03a344e-14b0-4433-a6a9-4b5f2c9dd9d5 req-4ee114d2-0fb2-4139-952b-9db7175add34 service nova] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] No waiting events found dispatching network-vif-unplugged-6b56baae-9530-49e2-a5b1-57474bac4edf {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:32:17 user nova-compute[75293]: DEBUG nova.compute.manager [req-c03a344e-14b0-4433-a6a9-4b5f2c9dd9d5 req-4ee114d2-0fb2-4139-952b-9db7175add34 service nova] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Received event network-vif-unplugged-6b56baae-9530-49e2-a5b1-57474bac4edf for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:32:18 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Instance destroyed successfully.
Nov 30 07:32:18 user nova-compute[75293]: DEBUG nova.objects.instance [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Lazy-loading 'resources' on Instance uuid 3aeab623-a85f-44d7-9ada-15df4910d953 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:32:18 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:30:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-548219607',display_name='tempest-VolumesNegativeTest-instance-548219607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-548219607',id=43,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:30:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8505a73af81489483a492a2c3f78f02',ramdisk_id='',reservation_id='r-0i3scmy6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1834648575',owner_user_name='tempest-VolumesNegativeTest-1834648575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:30:34Z,user_data=None,user_id='a72417e8e550485a816a264ed60dc307',uuid=3aeab623-a85f-44d7-9ada-15df4910d953,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b56baae-9530-49e2-a5b1-57474bac4edf", "address": "fa:16:3e:bf:8a:51", "network": {"id": "b9e6e49f-b3d6-4857-8043-636a22f30f91", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "552643428120431f8bbeadca55f077de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b56baae-95", "ovs_interfaceid": "6b56baae-9530-49e2-a5b1-57474bac4edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:32:18 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Converting VIF {"id": "6b56baae-9530-49e2-a5b1-57474bac4edf", "address": "fa:16:3e:bf:8a:51", "network": {"id": "b9e6e49f-b3d6-4857-8043-636a22f30f91", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "552643428120431f8bbeadca55f077de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b56baae-95", "ovs_interfaceid": "6b56baae-9530-49e2-a5b1-57474bac4edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:32:18 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:8a:51,bridge_name='br-int',has_traffic_filtering=True,id=6b56baae-9530-49e2-a5b1-57474bac4edf,network=Network(b9e6e49f-b3d6-4857-8043-636a22f30f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b56baae-95') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:32:18 user nova-compute[75293]: DEBUG os_vif [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:8a:51,bridge_name='br-int',has_traffic_filtering=True,id=6b56baae-9530-49e2-a5b1-57474bac4edf,network=Network(b9e6e49f-b3d6-4857-8043-636a22f30f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b56baae-95') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:32:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b56baae-95, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:32:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:32:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d27252d1-4153-427a-a4b5-032ff9f6b007) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:32:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:18 user nova-compute[75293]: INFO os_vif [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:8a:51,bridge_name='br-int',has_traffic_filtering=True,id=6b56baae-9530-49e2-a5b1-57474bac4edf,network=Network(b9e6e49f-b3d6-4857-8043-636a22f30f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b56baae-95')
Nov 30 07:32:18 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Deleting instance files /opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953_del
Nov 30 07:32:18 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Deletion of /opt/stack/data/nova/instances/3aeab623-a85f-44d7-9ada-15df4910d953_del complete
Nov 30 07:32:18 user nova-compute[75293]: INFO nova.compute.manager [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 30 07:32:18 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:32:18 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:32:18 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:32:18 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:32:18 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Took 0.45 seconds to deallocate network for instance.
Nov 30 07:32:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:32:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:32:19 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:32:19 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:32:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:32:19 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Deleted allocations for instance 3aeab623-a85f-44d7-9ada-15df4910d953
Nov 30 07:32:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-5668812c-f90a-439b-8a53-4ef2bf1279b7 tempest-VolumesNegativeTest-1834648575 tempest-VolumesNegativeTest-1834648575-project-member] Lock "3aeab623-a85f-44d7-9ada-15df4910d953" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.703s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:32:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-19fff4c1-56f6-4306-b3a6-5cc0ee2b5982 req-c6f7b638-fdb1-4752-8d37-b9920ed536a6 service nova] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Received event network-vif-plugged-6b56baae-9530-49e2-a5b1-57474bac4edf {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:32:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-19fff4c1-56f6-4306-b3a6-5cc0ee2b5982 req-c6f7b638-fdb1-4752-8d37-b9920ed536a6 service nova] Acquiring lock "3aeab623-a85f-44d7-9ada-15df4910d953-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:32:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-19fff4c1-56f6-4306-b3a6-5cc0ee2b5982 req-c6f7b638-fdb1-4752-8d37-b9920ed536a6 service nova] Lock "3aeab623-a85f-44d7-9ada-15df4910d953-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:32:20 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-19fff4c1-56f6-4306-b3a6-5cc0ee2b5982 req-c6f7b638-fdb1-4752-8d37-b9920ed536a6 service nova] Lock "3aeab623-a85f-44d7-9ada-15df4910d953-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:32:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-19fff4c1-56f6-4306-b3a6-5cc0ee2b5982 req-c6f7b638-fdb1-4752-8d37-b9920ed536a6 service nova] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] No waiting events found dispatching network-vif-plugged-6b56baae-9530-49e2-a5b1-57474bac4edf {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:32:20 user nova-compute[75293]: WARNING nova.compute.manager [req-19fff4c1-56f6-4306-b3a6-5cc0ee2b5982 req-c6f7b638-fdb1-4752-8d37-b9920ed536a6 service nova] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Received unexpected event network-vif-plugged-6b56baae-9530-49e2-a5b1-57474bac4edf for instance with vm_state deleted and task_state None.
Nov 30 07:32:20 user nova-compute[75293]: DEBUG nova.compute.manager [req-19fff4c1-56f6-4306-b3a6-5cc0ee2b5982 req-c6f7b638-fdb1-4752-8d37-b9920ed536a6 service nova] [instance: 3aeab623-a85f-44d7-9ada-15df4910d953] Received event network-vif-deleted-6b56baae-9530-49e2-a5b1-57474bac4edf {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:32:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "3e25b799-6205-4724-bffc-f36e93c1ca98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:32:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "3e25b799-6205-4724-bffc-f36e93c1ca98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:32:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "3e25b799-6205-4724-bffc-f36e93c1ca98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:32:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "3e25b799-6205-4724-bffc-f36e93c1ca98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:32:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "3e25b799-6205-4724-bffc-f36e93c1ca98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:32:21 user nova-compute[75293]: INFO nova.compute.manager [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Terminating instance
Nov 30 07:32:21 user nova-compute[75293]: DEBUG nova.compute.manager [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Start destroying the instance on the hypervisor. {{(pid=75293) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 30 07:32:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:21 user nova-compute[75293]: DEBUG nova.compute.manager [req-c3b958c9-4896-4229-919f-16bf496f2895 req-b659d033-c85d-49ed-a1df-8a6170d13cc2 service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Received event network-vif-unplugged-9570c6c3-691c-46d0-8922-7679cac177a3 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:32:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c3b958c9-4896-4229-919f-16bf496f2895 req-b659d033-c85d-49ed-a1df-8a6170d13cc2 service nova] Acquiring lock "3e25b799-6205-4724-bffc-f36e93c1ca98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:32:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c3b958c9-4896-4229-919f-16bf496f2895 req-b659d033-c85d-49ed-a1df-8a6170d13cc2 service nova] Lock "3e25b799-6205-4724-bffc-f36e93c1ca98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:32:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-c3b958c9-4896-4229-919f-16bf496f2895 req-b659d033-c85d-49ed-a1df-8a6170d13cc2 service nova] Lock "3e25b799-6205-4724-bffc-f36e93c1ca98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:32:21 user nova-compute[75293]: DEBUG nova.compute.manager [req-c3b958c9-4896-4229-919f-16bf496f2895 req-b659d033-c85d-49ed-a1df-8a6170d13cc2 service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] No waiting events found dispatching network-vif-unplugged-9570c6c3-691c-46d0-8922-7679cac177a3 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:32:21 user nova-compute[75293]: DEBUG nova.compute.manager [req-c3b958c9-4896-4229-919f-16bf496f2895 req-b659d033-c85d-49ed-a1df-8a6170d13cc2 service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Received event network-vif-unplugged-9570c6c3-691c-46d0-8922-7679cac177a3 for instance with task_state deleting. {{(pid=75293) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG nova.compute.manager [req-7fc4c873-77ea-4049-ba90-831dfaf90676 req-aa00a484-5d04-4245-9ba4-b74ecf1838bf service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Received event network-changed-9570c6c3-691c-46d0-8922-7679cac177a3 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG nova.compute.manager [req-7fc4c873-77ea-4049-ba90-831dfaf90676 req-aa00a484-5d04-4245-9ba4-b74ecf1838bf service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Refreshing instance network info cache due to event network-changed-9570c6c3-691c-46d0-8922-7679cac177a3. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7fc4c873-77ea-4049-ba90-831dfaf90676 req-aa00a484-5d04-4245-9ba4-b74ecf1838bf service nova] Acquiring lock "refresh_cache-3e25b799-6205-4724-bffc-f36e93c1ca98" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7fc4c873-77ea-4049-ba90-831dfaf90676 req-aa00a484-5d04-4245-9ba4-b74ecf1838bf service nova] Acquired lock "refresh_cache-3e25b799-6205-4724-bffc-f36e93c1ca98" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG nova.network.neutron [req-7fc4c873-77ea-4049-ba90-831dfaf90676 req-aa00a484-5d04-4245-9ba4-b74ecf1838bf service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Refreshing network info cache for port 9570c6c3-691c-46d0-8922-7679cac177a3 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:32:22 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Instance destroyed successfully.
Nov 30 07:32:22 user nova-compute[75293]: DEBUG nova.objects.instance [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lazy-loading 'resources' on Instance uuid 3e25b799-6205-4724-bffc-f36e93c1ca98 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:30:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1626084373',display_name='tempest-TestVolumeBootPattern-server-1626084373',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1626084373',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjYpNawIGYigccNKqOMu5B2KkHiW6PJtAwx4gnV2Bz3ppJhyMPL2myvnkPDsvqitKRsm9L8h5UrColCNNTtOYkZ/lhfNHFXjjmmY5PKfn3zACvSADMpOWwtUHdyXG+/2Q==',key_name='tempest-TestVolumeBootPattern-112031280',keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:30:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4bfa84ea3874ba7ac0af4c3b1d2f918',ramdisk_id='',reservation_id='r-iugzfhqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-273596612',owner_user_name='tempest-TestVolumeBootPattern-273596612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-30T07:30:43Z,user_data=None,user_id='fbee62d1b15144cc9d433a4a64dd12a7',uuid=3e25b799-6205-4724-bffc-f36e93c1ca98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9570c6c3-691c-46d0-8922-7679cac177a3", "address": "fa:16:3e:95:9e:b8", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9570c6c3-69", "ovs_interfaceid": "9570c6c3-691c-46d0-8922-7679cac177a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converting VIF {"id": "9570c6c3-691c-46d0-8922-7679cac177a3", "address": "fa:16:3e:95:9e:b8", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9570c6c3-69", "ovs_interfaceid": "9570c6c3-691c-46d0-8922-7679cac177a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:9e:b8,bridge_name='br-int',has_traffic_filtering=True,id=9570c6c3-691c-46d0-8922-7679cac177a3,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9570c6c3-69') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_vif [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:9e:b8,bridge_name='br-int',has_traffic_filtering=True,id=9570c6c3-691c-46d0-8922-7679cac177a3,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9570c6c3-69') {{(pid=75293) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9570c6c3-69, bridge=br-int, if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c803251-6e32-4643-8b01-4ea32d08ea98) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:22 user nova-compute[75293]: INFO os_vif [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:9e:b8,bridge_name='br-int',has_traffic_filtering=True,id=9570c6c3-691c-46d0-8922-7679cac177a3,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9570c6c3-69')
Nov 30 07:32:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] calling os-brick to detach iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, {'target_iqn': 'iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvFEBmco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:32:22 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc95cd9-a807-4c6a-9a19-3f31ade1e329]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 30 07:32:22 user nova-compute[75293]: No targets found.
Nov 30 07:32:22 user nova-compute[75293]: iSNS:
Nov 30 07:32:22 user nova-compute[75293]: No targets found.
Nov 30 07:32:22 user nova-compute[75293]: STATIC:
Nov 30 07:32:22 user nova-compute[75293]: Target: iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff
Nov 30 07:32:22 user nova-compute[75293]:         Portal: 172.16.0.220:3260,-1
Nov 30 07:32:22 user nova-compute[75293]:                 Iface Name: default
Nov 30 07:32:22 user nova-compute[75293]: FIRMWARE:
Nov 30 07:32:22 user nova-compute[75293]: No targets found.
Nov 30 07:32:22 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 30 07:32:22 user nova-compute[75293]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 30 07:32:22 user nova-compute[75293]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75293) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff', 0)] {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[8293462e-f965-4c13-9ca1-cd40cdf3e61a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[83909d25-61ec-4603-b325-7c7218e00119]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff (non-flash)
Nov 30 07:32:22 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff (non-flash)
Nov 30 07:32:22 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7effe81b20e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff'): ({'sdb'}, set())}) {{(pid=75293) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Removing single pathed devices sdb {{(pid=75293) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad66270-20cf-481e-8066-c00f9d460c9a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG nova.network.neutron [req-7fc4c873-77ea-4049-ba90-831dfaf90676 req-aa00a484-5d04-4245-9ba4-b74ecf1838bf service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Updated VIF entry in instance network info cache for port 9570c6c3-691c-46d0-8922-7679cac177a3. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG nova.network.neutron [req-7fc4c873-77ea-4049-ba90-831dfaf90676 req-aa00a484-5d04-4245-9ba4-b74ecf1838bf service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Updating instance_info_cache with network_info: [{"id": "9570c6c3-691c-46d0-8922-7679cac177a3", "address": "fa:16:3e:95:9e:b8", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9570c6c3-69", "ovs_interfaceid": "9570c6c3-691c-46d0-8922-7679cac177a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b2e541-b967-4638-9e58-55d20eddbd58]: (4, ('ok\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Flushing IO for device /dev/sdb {{(pid=75293) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7fc4c873-77ea-4049-ba90-831dfaf90676 req-aa00a484-5d04-4245-9ba4-b74ecf1838bf service nova] Releasing lock "refresh_cache-3e25b799-6205-4724-bffc-f36e93c1ca98" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[622095ef-5fd2-4460-8a91-0543f691f1a2]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75293) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[911a2203-8304-49ed-80f8-ea306e697e09]: (4, ('1', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] SCSI volumes sdb have been removed. {{(pid=75293) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26234373535356533', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4e5eabe9', '/dev/disk/by-id/scsi-1SCST_BIO4e5eabe9-b47555e3a944a0cc') {{(pid=86417) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb6717f-c41a-4e44-bd73-20fd2dd1237d]: (4, None) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff')] {{(pid=75293) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cc2bb1-55db-4cb9-892b-77207cc9094a]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --logout {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[24357eca-bfb6-4379-9963-c69898c84798]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff, portal: 172.16.0.220,3260]
Nov 30 07:32:22 user nova-compute[75293]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff, portal: 172.16.0.220,3260] successful.
Nov 30 07:32:22 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op delete {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2f81a1-2040-439e-88cd-e4b0e142283c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] <== disconnect_volume: return (309ms) None {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Disconnected iSCSI Volume {{(pid=75293) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 30 07:32:22 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Deleting instance files /opt/stack/data/nova/instances/3e25b799-6205-4724-bffc-f36e93c1ca98_del
Nov 30 07:32:22 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Deletion of /opt/stack/data/nova/instances/3e25b799-6205-4724-bffc-f36e93c1ca98_del complete
Nov 30 07:32:22 user nova-compute[75293]: INFO nova.compute.manager [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 30 07:32:22 user nova-compute[75293]: DEBUG oslo.service.loopingcall [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75293) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG nova.compute.manager [-] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Deallocating network for instance {{(pid=75293) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 30 07:32:22 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] deallocate_for_instance() {{(pid=75293) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 30 07:32:23 user nova-compute[75293]: DEBUG nova.network.neutron [-] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Updating instance_info_cache with network_info: [] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:32:23 user nova-compute[75293]: INFO nova.compute.manager [-] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Took 0.75 seconds to deallocate network for instance.
Nov 30 07:32:23 user nova-compute[75293]: DEBUG nova.compute.manager [req-7ae77516-d4ed-4f98-a754-04e4011d0a45 req-fcb33802-e81a-407f-b77d-98bb014577ff service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Received event network-vif-plugged-9570c6c3-691c-46d0-8922-7679cac177a3 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:32:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7ae77516-d4ed-4f98-a754-04e4011d0a45 req-fcb33802-e81a-407f-b77d-98bb014577ff service nova] Acquiring lock "3e25b799-6205-4724-bffc-f36e93c1ca98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:32:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7ae77516-d4ed-4f98-a754-04e4011d0a45 req-fcb33802-e81a-407f-b77d-98bb014577ff service nova] Lock "3e25b799-6205-4724-bffc-f36e93c1ca98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:32:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-7ae77516-d4ed-4f98-a754-04e4011d0a45 req-fcb33802-e81a-407f-b77d-98bb014577ff service nova] Lock "3e25b799-6205-4724-bffc-f36e93c1ca98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:32:23 user nova-compute[75293]: DEBUG nova.compute.manager [req-7ae77516-d4ed-4f98-a754-04e4011d0a45 req-fcb33802-e81a-407f-b77d-98bb014577ff service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] No waiting events found dispatching network-vif-plugged-9570c6c3-691c-46d0-8922-7679cac177a3 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:32:23 user nova-compute[75293]: WARNING nova.compute.manager [req-7ae77516-d4ed-4f98-a754-04e4011d0a45 req-fcb33802-e81a-407f-b77d-98bb014577ff service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Received unexpected event network-vif-plugged-9570c6c3-691c-46d0-8922-7679cac177a3 for instance with vm_state active and task_state deleting.
Nov 30 07:32:24 user nova-compute[75293]: DEBUG nova.compute.manager [req-a6690760-8fe9-4fd6-8c06-edec6dfa481b req-23c84815-1eb5-4cae-915a-88c86cacdb93 service nova] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Received event network-vif-deleted-9570c6c3-691c-46d0-8922-7679cac177a3 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:32:24 user nova-compute[75293]: INFO nova.compute.manager [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 3e25b799-6205-4724-bffc-f36e93c1ca98] Took 0.77 seconds to detach 1 volumes for instance.
Nov 30 07:32:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:32:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:32:24 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:32:24 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:32:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:32:24 user nova-compute[75293]: INFO nova.scheduler.client.report [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Deleted allocations for instance 3e25b799-6205-4724-bffc-f36e93c1ca98
Nov 30 07:32:24 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-c18c0c57-87e6-47eb-9cb8-b173f8a76205 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "3e25b799-6205-4724-bffc-f36e93c1ca98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.018s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:32:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:32:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75293) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 30 07:32:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:32:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75293) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 30 07:32:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:32:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:32:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:32:52 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:32:53 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:32:53 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75293) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 30 07:32:56 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:32:56 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Cleaning up deleted instances {{(pid=75293) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 30 07:32:56 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] There are 0 instances to clean {{(pid=75293) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 30 07:32:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:32:59 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:03 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:33:04 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:04 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:33:04 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:33:05 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:33:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:06 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:33:06 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Acquiring lock "fe9edc76-b8b7-4bf1-9f44-513624f4d1ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Lock "fe9edc76-b8b7-4bf1-9f44-513624f4d1ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:33:09 user nova-compute[75293]: INFO nova.compute.claims [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Claim successful on node user
Nov 30 07:33:09 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Refreshing inventories for resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Updating ProviderTree inventory for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Updating inventory in ProviderTree for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Refreshing aggregate associations for resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa, aggregates: None {{(pid=75293) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Refreshing trait associations for resource provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV {{(pid=75293) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:33:09 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:33:09 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG nova.policy [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da8574eb61384e3e95f92c87fe28d5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151d71f14a884e82b07ca47286c727cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:33:09 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Creating image(s)
Nov 30 07:33:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe9edc76-b8b7-4bf1-9f44-513624f4d1ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Lock "/opt/stack/data/nova/instances/fe9edc76-b8b7-4bf1-9f44-513624f4d1ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Lock "/opt/stack/data/nova/instances/fe9edc76-b8b7-4bf1-9f44-513624f4d1ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.213s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.172s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/fe9edc76-b8b7-4bf1-9f44-513624f4d1ea/disk 1073741824 {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/fe9edc76-b8b7-4bf1-9f44-513624f4d1ea/disk 1073741824" returned: 0 in 0.065s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Successfully created port: f124c8a8-7ab8-4acf-ab92-b946696bcc91 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.179s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe9edc76-b8b7-4bf1-9f44-513624f4d1ea/disk. size=1073741824 {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe9edc76-b8b7-4bf1-9f44-513624f4d1ea/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe9edc76-b8b7-4bf1-9f44-513624f4d1ea/disk --force-share --output=json" returned: 0 in 0.466s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.disk.api [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Cannot resize image /opt/stack/data/nova/instances/fe9edc76-b8b7-4bf1-9f44-513624f4d1ea/disk to a smaller size. {{(pid=75293) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Ensure instance console log exists: /opt/stack/data/nova/instances/fe9edc76-b8b7-4bf1-9f44-513624f4d1ea/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:11 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:33:11 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=8799MB free_disk=25.094478607177734GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 23bca083-fc9b-439b-9c5d-463c1187a5d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 19f93a6a-cff3-412a-aefa-85d45ce86132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance fe9edc76-b8b7-4bf1-9f44-513624f4d1ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Successfully updated port: f124c8a8-7ab8-4acf-ab92-b946696bcc91 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Acquiring lock "refresh_cache-fe9edc76-b8b7-4bf1-9f44-513624f4d1ea" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Acquired lock "refresh_cache-fe9edc76-b8b7-4bf1-9f44-513624f4d1ea" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-8f6bd0d9-0c68-48ca-9986-6456ceaa70e6 req-934e1f76-6147-47a1-97b7-2478ba6ce44b service nova] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Received event network-changed-f124c8a8-7ab8-4acf-ab92-b946696bcc91 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.compute.manager [req-8f6bd0d9-0c68-48ca-9986-6456ceaa70e6 req-934e1f76-6147-47a1-97b7-2478ba6ce44b service nova] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Refreshing instance network info cache due to event network-changed-f124c8a8-7ab8-4acf-ab92-b946696bcc91. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8f6bd0d9-0c68-48ca-9986-6456ceaa70e6 req-934e1f76-6147-47a1-97b7-2478ba6ce44b service nova] Acquiring lock "refresh_cache-fe9edc76-b8b7-4bf1-9f44-513624f4d1ea" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Updating instance_info_cache with network_info: [{"id": "f124c8a8-7ab8-4acf-ab92-b946696bcc91", "address": "fa:16:3e:6b:f7:82", "network": {"id": "d48bb645-f234-4e66-9037-85ba8c0ce143", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2608731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151d71f14a884e82b07ca47286c727cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124c8a8-7a", "ovs_interfaceid": "f124c8a8-7ab8-4acf-ab92-b946696bcc91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Releasing lock "refresh_cache-fe9edc76-b8b7-4bf1-9f44-513624f4d1ea" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Instance network_info: |[{"id": "f124c8a8-7ab8-4acf-ab92-b946696bcc91", "address": "fa:16:3e:6b:f7:82", "network": {"id": "d48bb645-f234-4e66-9037-85ba8c0ce143", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2608731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151d71f14a884e82b07ca47286c727cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124c8a8-7a", "ovs_interfaceid": "f124c8a8-7ab8-4acf-ab92-b946696bcc91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8f6bd0d9-0c68-48ca-9986-6456ceaa70e6 req-934e1f76-6147-47a1-97b7-2478ba6ce44b service nova] Acquired lock "refresh_cache-fe9edc76-b8b7-4bf1-9f44-513624f4d1ea" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.network.neutron [req-8f6bd0d9-0c68-48ca-9986-6456ceaa70e6 req-934e1f76-6147-47a1-97b7-2478ba6ce44b service nova] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Refreshing network info cache for port f124c8a8-7ab8-4acf-ab92-b946696bcc91 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Start _get_guest_xml network_info=[{"id": "f124c8a8-7ab8-4acf-ab92-b946696bcc91", "address": "fa:16:3e:6b:f7:82", "network": {"id": "d48bb645-f234-4e66-9037-85ba8c0ce143", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2608731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151d71f14a884e82b07ca47286c727cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124c8a8-7a", "ovs_interfaceid": "f124c8a8-7ab8-4acf-ab92-b946696bcc91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:33:11 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:33:11 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1798746139',display_name='tempest-AttachVolumeTestJSON-server-1798746139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1798746139',id=47,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIncJbChOmkNBxl/ezn/fjk6INGIjx7a86zAKOdSyc3xE8faMIhXYqi49UrWHWY1TvvNBSjz5dop2pz6zn4GUy28Zy8dtOuJZVS1pO7pGc/lYUG91ylahfkJYyBjreMIw==',key_name='tempest-keypair-1502389921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='151d71f14a884e82b07ca47286c727cd',ramdisk_id='',reservation_id='r-mhfaas58',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1051618444',owner_user_name='tempest-AttachVolumeTestJSON-1051618444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:33:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da8574eb61384e3e95f92c87fe28d5fb',uuid=fe9edc76-b8b7-4bf1-9f44-513624f4d1ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f124c8a8-7ab8-4acf-ab92-b946696bcc91", "address": "fa:16:3e:6b:f7:82", "network": {"id": "d48bb645-f234-4e66-9037-85ba8c0ce143", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2608731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151d71f14a884e82b07ca47286c727cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124c8a8-7a", "ovs_interfaceid": "f124c8a8-7ab8-4acf-ab92-b946696bcc91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Converting VIF {"id": "f124c8a8-7ab8-4acf-ab92-b946696bcc91", "address": "fa:16:3e:6b:f7:82", "network": {"id": "d48bb645-f234-4e66-9037-85ba8c0ce143", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2608731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151d71f14a884e82b07ca47286c727cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124c8a8-7a", "ovs_interfaceid": "f124c8a8-7ab8-4acf-ab92-b946696bcc91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f7:82,bridge_name='br-int',has_traffic_filtering=True,id=f124c8a8-7ab8-4acf-ab92-b946696bcc91,network=Network(d48bb645-f234-4e66-9037-85ba8c0ce143),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf124c8a8-7a') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Lazy-loading 'pci_devices' on Instance uuid fe9edc76-b8b7-4bf1-9f44-513624f4d1ea {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:33:11 user nova-compute[75293]:   <uuid>fe9edc76-b8b7-4bf1-9f44-513624f4d1ea</uuid>
Nov 30 07:33:11 user nova-compute[75293]:   <name>instance-0000002f</name>
Nov 30 07:33:11 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:33:11 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:33:11 user nova-compute[75293]:   <metadata>
Nov 30 07:33:11 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:33:11 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:33:11 user nova-compute[75293]:       <nova:name>tempest-AttachVolumeTestJSON-server-1798746139</nova:name>
Nov 30 07:33:11 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:33:11</nova:creationTime>
Nov 30 07:33:11 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:33:11 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:33:11 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:33:11 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:33:11 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:33:11 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:33:11 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:33:11 user nova-compute[75293]:       <nova:owner>
Nov 30 07:33:11 user nova-compute[75293]:         <nova:user uuid="da8574eb61384e3e95f92c87fe28d5fb">tempest-AttachVolumeTestJSON-1051618444-project-member</nova:user>
Nov 30 07:33:11 user nova-compute[75293]:         <nova:project uuid="151d71f14a884e82b07ca47286c727cd">tempest-AttachVolumeTestJSON-1051618444</nova:project>
Nov 30 07:33:11 user nova-compute[75293]:       </nova:owner>
Nov 30 07:33:11 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:33:11 user nova-compute[75293]:       <nova:ports>
Nov 30 07:33:11 user nova-compute[75293]:         <nova:port uuid="f124c8a8-7ab8-4acf-ab92-b946696bcc91">
Nov 30 07:33:11 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 30 07:33:11 user nova-compute[75293]:         </nova:port>
Nov 30 07:33:11 user nova-compute[75293]:       </nova:ports>
Nov 30 07:33:11 user nova-compute[75293]:     </nova:instance>
Nov 30 07:33:11 user nova-compute[75293]:   </metadata>
Nov 30 07:33:11 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:33:11 user nova-compute[75293]:     <system>
Nov 30 07:33:11 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:33:11 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:33:11 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:33:11 user nova-compute[75293]:       <entry name="serial">fe9edc76-b8b7-4bf1-9f44-513624f4d1ea</entry>
Nov 30 07:33:11 user nova-compute[75293]:       <entry name="uuid">fe9edc76-b8b7-4bf1-9f44-513624f4d1ea</entry>
Nov 30 07:33:11 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:33:11 user nova-compute[75293]:     </system>
Nov 30 07:33:11 user nova-compute[75293]:   </sysinfo>
Nov 30 07:33:11 user nova-compute[75293]:   <os>
Nov 30 07:33:11 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:33:11 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:33:11 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:33:11 user nova-compute[75293]:   </os>
Nov 30 07:33:11 user nova-compute[75293]:   <features>
Nov 30 07:33:11 user nova-compute[75293]:     <acpi/>
Nov 30 07:33:11 user nova-compute[75293]:     <apic/>
Nov 30 07:33:11 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:33:11 user nova-compute[75293]:   </features>
Nov 30 07:33:11 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:33:11 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:33:11 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:33:11 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:33:11 user nova-compute[75293]:   </clock>
Nov 30 07:33:11 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:33:11 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:33:11 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:33:11 user nova-compute[75293]:   </cpu>
Nov 30 07:33:11 user nova-compute[75293]:   <devices>
Nov 30 07:33:11 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:33:11 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:33:11 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/fe9edc76-b8b7-4bf1-9f44-513624f4d1ea/disk"/>
Nov 30 07:33:11 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:33:11 user nova-compute[75293]:     </disk>
Nov 30 07:33:11 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:33:11 user nova-compute[75293]:       <mac address="fa:16:3e:6b:f7:82"/>
Nov 30 07:33:11 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:33:11 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:33:11 user nova-compute[75293]:       <target dev="tapf124c8a8-7a"/>
Nov 30 07:33:11 user nova-compute[75293]:     </interface>
Nov 30 07:33:11 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:33:11 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/fe9edc76-b8b7-4bf1-9f44-513624f4d1ea/console.log" append="off"/>
Nov 30 07:33:11 user nova-compute[75293]:     </serial>
Nov 30 07:33:11 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:33:11 user nova-compute[75293]:     <video>
Nov 30 07:33:11 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:33:11 user nova-compute[75293]:     </video>
Nov 30 07:33:11 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:33:11 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:33:11 user nova-compute[75293]:     </rng>
Nov 30 07:33:11 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:33:11 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:33:11 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:33:11 user nova-compute[75293]:     </memballoon>
Nov 30 07:33:11 user nova-compute[75293]:   </devices>
Nov 30 07:33:11 user nova-compute[75293]: </domain>
Nov 30 07:33:11 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1798746139',display_name='tempest-AttachVolumeTestJSON-server-1798746139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1798746139',id=47,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIncJbChOmkNBxl/ezn/fjk6INGIjx7a86zAKOdSyc3xE8faMIhXYqi49UrWHWY1TvvNBSjz5dop2pz6zn4GUy28Zy8dtOuJZVS1pO7pGc/lYUG91ylahfkJYyBjreMIw==',key_name='tempest-keypair-1502389921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='151d71f14a884e82b07ca47286c727cd',ramdisk_id='',reservation_id='r-mhfaas58',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1051618444',owner_user_name='tempest-AttachVolumeTestJSON-1051618444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:33:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da8574eb61384e3e95f92c87fe28d5fb',uuid=fe9edc76-b8b7-4bf1-9f44-513624f4d1ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f124c8a8-7ab8-4acf-ab92-b946696bcc91", "address": "fa:16:3e:6b:f7:82", "network": {"id": "d48bb645-f234-4e66-9037-85ba8c0ce143", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2608731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151d71f14a884e82b07ca47286c727cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124c8a8-7a", "ovs_interfaceid": "f124c8a8-7ab8-4acf-ab92-b946696bcc91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Converting VIF {"id": "f124c8a8-7ab8-4acf-ab92-b946696bcc91", "address": "fa:16:3e:6b:f7:82", "network": {"id": "d48bb645-f234-4e66-9037-85ba8c0ce143", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2608731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151d71f14a884e82b07ca47286c727cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124c8a8-7a", "ovs_interfaceid": "f124c8a8-7ab8-4acf-ab92-b946696bcc91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f7:82,bridge_name='br-int',has_traffic_filtering=True,id=f124c8a8-7ab8-4acf-ab92-b946696bcc91,network=Network(d48bb645-f234-4e66-9037-85ba8c0ce143),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf124c8a8-7a') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG os_vif [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f7:82,bridge_name='br-int',has_traffic_filtering=True,id=f124c8a8-7ab8-4acf-ab92-b946696bcc91,network=Network(d48bb645-f234-4e66-9037-85ba8c0ce143),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf124c8a8-7a') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c32f058-77fe-590f-95fe-737398ac67ec', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf124c8a8-7a, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf124c8a8-7a, col_values=(('qos', UUID('c7583a14-9b10-49ad-90a9-183e5d7b8bef')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf124c8a8-7a, col_values=(('external_ids', {'iface-id': 'f124c8a8-7ab8-4acf-ab92-b946696bcc91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:f7:82', 'vm-uuid': 'fe9edc76-b8b7-4bf1-9f44-513624f4d1ea'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:11 user nova-compute[75293]: INFO os_vif [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f7:82,bridge_name='br-int',has_traffic_filtering=True,id=f124c8a8-7ab8-4acf-ab92-b946696bcc91,network=Network(d48bb645-f234-4e66-9037-85ba8c0ce143),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf124c8a8-7a')
Nov 30 07:33:11 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:33:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] No VIF found with MAC fa:16:3e:6b:f7:82, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:33:12 user nova-compute[75293]: DEBUG nova.network.neutron [req-8f6bd0d9-0c68-48ca-9986-6456ceaa70e6 req-934e1f76-6147-47a1-97b7-2478ba6ce44b service nova] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Updated VIF entry in instance network info cache for port f124c8a8-7ab8-4acf-ab92-b946696bcc91. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:33:12 user nova-compute[75293]: DEBUG nova.network.neutron [req-8f6bd0d9-0c68-48ca-9986-6456ceaa70e6 req-934e1f76-6147-47a1-97b7-2478ba6ce44b service nova] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Updating instance_info_cache with network_info: [{"id": "f124c8a8-7ab8-4acf-ab92-b946696bcc91", "address": "fa:16:3e:6b:f7:82", "network": {"id": "d48bb645-f234-4e66-9037-85ba8c0ce143", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2608731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151d71f14a884e82b07ca47286c727cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124c8a8-7a", "ovs_interfaceid": "f124c8a8-7ab8-4acf-ab92-b946696bcc91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:33:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-8f6bd0d9-0c68-48ca-9986-6456ceaa70e6 req-934e1f76-6147-47a1-97b7-2478ba6ce44b service nova] Releasing lock "refresh_cache-fe9edc76-b8b7-4bf1-9f44-513624f4d1ea" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:33:12 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:33:12 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "75ab4c21-badd-4aaf-8dab-da3c6ab84d46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "75ab4c21-badd-4aaf-8dab-da3c6ab84d46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Starting instance... {{(pid=75293) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG nova.compute.manager [req-139dd818-b97c-4a72-9b95-5c287dab43b7 req-0badd2bb-2caa-43c0-87d8-dc44a6201bf8 service nova] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Received event network-vif-plugged-f124c8a8-7ab8-4acf-ab92-b946696bcc91 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-139dd818-b97c-4a72-9b95-5c287dab43b7 req-0badd2bb-2caa-43c0-87d8-dc44a6201bf8 service nova] Acquiring lock "fe9edc76-b8b7-4bf1-9f44-513624f4d1ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-139dd818-b97c-4a72-9b95-5c287dab43b7 req-0badd2bb-2caa-43c0-87d8-dc44a6201bf8 service nova] Lock "fe9edc76-b8b7-4bf1-9f44-513624f4d1ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.012s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-139dd818-b97c-4a72-9b95-5c287dab43b7 req-0badd2bb-2caa-43c0-87d8-dc44a6201bf8 service nova] Lock "fe9edc76-b8b7-4bf1-9f44-513624f4d1ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG nova.compute.manager [req-139dd818-b97c-4a72-9b95-5c287dab43b7 req-0badd2bb-2caa-43c0-87d8-dc44a6201bf8 service nova] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] No waiting events found dispatching network-vif-plugged-f124c8a8-7ab8-4acf-ab92-b946696bcc91 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:33:13 user nova-compute[75293]: WARNING nova.compute.manager [req-139dd818-b97c-4a72-9b95-5c287dab43b7 req-0badd2bb-2caa-43c0-87d8-dc44a6201bf8 service nova] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Received unexpected event network-vif-plugged-f124c8a8-7ab8-4acf-ab92-b946696bcc91 for instance with vm_state building and task_state spawning.
Nov 30 07:33:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75293) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 30 07:33:13 user nova-compute[75293]: INFO nova.compute.claims [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Claim successful on node user
Nov 30 07:33:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Start building networks asynchronously for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Allocating IP information in the background. {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 30 07:33:13 user nova-compute[75293]: DEBUG nova.network.neutron [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] allocate_for_instance() {{(pid=75293) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 30 07:33:13 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 30 07:33:13 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Start building block device mappings for instance. {{(pid=75293) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 30 07:33:13 user nova-compute[75293]: INFO nova.virt.block_device [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Booting with volume 3b0b2927-e7ca-4b73-baf1-9d4c51b46dff at /dev/vda
Nov 30 07:33:13 user nova-compute[75293]: DEBUG nova.policy [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbee62d1b15144cc9d433a4a64dd12a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa84ea3874ba7ac0af4c3b1d2f918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75293) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG os_brick.utils [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c03402-4286-4886-962f-6f644d5234f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9d3dec979d6\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[802f9f0f-9375-4e56-9029-699736244d36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a6e353-4c05-44f8-8a43-ce1f7384a97a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[acea0a36-5251-468b-834b-393f4d4bcb4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Running cmd (subprocess): nvme version {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] 'nvme version' failed. Not Retrying. {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] nvme not present on system {{(pid=75293) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 30 07:33:14 user nova-compute[75293]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 30 07:33:14 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52e4d3b-6f67-4055-a922-3656a1e15e70]: (4, '') {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75293) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.lightos [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] LIGHTOS: no hostnqn found. {{(pid=75293) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG os_brick.utils [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9d3dec979d6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG nova.virt.block_device [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Updating existing volume attachment record: b5585824-90b4-43a0-8672-1c29dfe78dda {{(pid=75293) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG nova.network.neutron [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Successfully created port: f7c2846c-289f-42c1-a924-8deac18f3d32 {{(pid=75293) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:33:14 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Didn't find any instances for network info cache update. {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:33:15 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Instance spawned successfully.
Nov 30 07:33:15 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG nova.network.neutron [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Successfully updated port: f7c2846c-289f-42c1-a924-8deac18f3d32 {{(pid=75293) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "refresh_cache-75ab4c21-badd-4aaf-8dab-da3c6ab84d46" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquired lock "refresh_cache-75ab4c21-badd-4aaf-8dab-da3c6ab84d46" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG nova.network.neutron [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG nova.network.neutron [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Instance cache missing network info. {{(pid=75293) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 30 07:33:15 user nova-compute[75293]: INFO nova.compute.manager [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 30 07:33:15 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-e489197b-0f3d-45d9-aa46-e3194fd9edb5 req-cb97a6ba-b89c-4e2e-b043-e1483db1595d service nova] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Received event network-vif-plugged-f124c8a8-7ab8-4acf-ab92-b946696bcc91 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e489197b-0f3d-45d9-aa46-e3194fd9edb5 req-cb97a6ba-b89c-4e2e-b043-e1483db1595d service nova] Acquiring lock "fe9edc76-b8b7-4bf1-9f44-513624f4d1ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e489197b-0f3d-45d9-aa46-e3194fd9edb5 req-cb97a6ba-b89c-4e2e-b043-e1483db1595d service nova] Lock "fe9edc76-b8b7-4bf1-9f44-513624f4d1ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e489197b-0f3d-45d9-aa46-e3194fd9edb5 req-cb97a6ba-b89c-4e2e-b043-e1483db1595d service nova] Lock "fe9edc76-b8b7-4bf1-9f44-513624f4d1ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-e489197b-0f3d-45d9-aa46-e3194fd9edb5 req-cb97a6ba-b89c-4e2e-b043-e1483db1595d service nova] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] No waiting events found dispatching network-vif-plugged-f124c8a8-7ab8-4acf-ab92-b946696bcc91 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:33:15 user nova-compute[75293]: WARNING nova.compute.manager [req-e489197b-0f3d-45d9-aa46-e3194fd9edb5 req-cb97a6ba-b89c-4e2e-b043-e1483db1595d service nova] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Received unexpected event network-vif-plugged-f124c8a8-7ab8-4acf-ab92-b946696bcc91 for instance with vm_state building and task_state spawning.
Nov 30 07:33:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-e489197b-0f3d-45d9-aa46-e3194fd9edb5 req-cb97a6ba-b89c-4e2e-b043-e1483db1595d service nova] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Received event network-changed-f7c2846c-289f-42c1-a924-8deac18f3d32 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG nova.compute.manager [req-e489197b-0f3d-45d9-aa46-e3194fd9edb5 req-cb97a6ba-b89c-4e2e-b043-e1483db1595d service nova] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Refreshing instance network info cache due to event network-changed-f7c2846c-289f-42c1-a924-8deac18f3d32. {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e489197b-0f3d-45d9-aa46-e3194fd9edb5 req-cb97a6ba-b89c-4e2e-b043-e1483db1595d service nova] Acquiring lock "refresh_cache-75ab4c21-badd-4aaf-8dab-da3c6ab84d46" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:33:15 user nova-compute[75293]: INFO nova.compute.manager [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] [instance: fe9edc76-b8b7-4bf1-9f44-513624f4d1ea] Took 6.32 seconds to build instance.
Nov 30 07:33:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8b3c642b-c68a-4fe0-b72f-78d23734ba0f tempest-AttachVolumeTestJSON-1051618444 tempest-AttachVolumeTestJSON-1051618444-project-member] Lock "fe9edc76-b8b7-4bf1-9f44-513624f4d1ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.419s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:15 user nova-compute[75293]: DEBUG nova.network.neutron [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Updating instance_info_cache with network_info: [{"id": "f7c2846c-289f-42c1-a924-8deac18f3d32", "address": "fa:16:3e:7b:bb:62", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c2846c-28", "ovs_interfaceid": "f7c2846c-289f-42c1-a924-8deac18f3d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:33:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Releasing lock "refresh_cache-75ab4c21-badd-4aaf-8dab-da3c6ab84d46" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:33:16 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Instance network_info: |[{"id": "f7c2846c-289f-42c1-a924-8deac18f3d32", "address": "fa:16:3e:7b:bb:62", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c2846c-28", "ovs_interfaceid": "f7c2846c-289f-42c1-a924-8deac18f3d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75293) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 30 07:33:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e489197b-0f3d-45d9-aa46-e3194fd9edb5 req-cb97a6ba-b89c-4e2e-b043-e1483db1595d service nova] Acquired lock "refresh_cache-75ab4c21-badd-4aaf-8dab-da3c6ab84d46" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:33:16 user nova-compute[75293]: DEBUG nova.network.neutron [req-e489197b-0f3d-45d9-aa46-e3194fd9edb5 req-cb97a6ba-b89c-4e2e-b043-e1483db1595d service nova] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Refreshing network info cache for port f7c2846c-289f-42c1-a924-8deac18f3d32 {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 30 07:33:16 user nova-compute[75293]: DEBUG nova.network.neutron [req-e489197b-0f3d-45d9-aa46-e3194fd9edb5 req-cb97a6ba-b89c-4e2e-b043-e1483db1595d service nova] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Updated VIF entry in instance network info cache for port f7c2846c-289f-42c1-a924-8deac18f3d32. {{(pid=75293) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 30 07:33:16 user nova-compute[75293]: DEBUG nova.network.neutron [req-e489197b-0f3d-45d9-aa46-e3194fd9edb5 req-cb97a6ba-b89c-4e2e-b043-e1483db1595d service nova] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Updating instance_info_cache with network_info: [{"id": "f7c2846c-289f-42c1-a924-8deac18f3d32", "address": "fa:16:3e:7b:bb:62", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c2846c-28", "ovs_interfaceid": "f7c2846c-289f-42c1-a924-8deac18f3d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:33:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-e489197b-0f3d-45d9-aa46-e3194fd9edb5 req-cb97a6ba-b89c-4e2e-b043-e1483db1595d service nova] Releasing lock "refresh_cache-75ab4c21-badd-4aaf-8dab-da3c6ab84d46" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:33:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:16 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:17 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:33:17 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:33:17 user nova-compute[75293]: INFO nova.compute.manager [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Rescuing
Nov 30 07:33:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Acquiring lock "refresh_cache-19f93a6a-cff3-412a-aefa-85d45ce86132" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:33:17 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Acquired lock "refresh_cache-19f93a6a-cff3-412a-aefa-85d45ce86132" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:33:17 user nova-compute[75293]: DEBUG nova.network.neutron [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Building network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 30 07:33:18 user nova-compute[75293]: DEBUG nova.network.neutron [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Updating instance_info_cache with network_info: [{"id": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "address": "fa:16:3e:66:a7:3e", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf788a7f8-c7", "ovs_interfaceid": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:33:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Releasing lock "refresh_cache-19f93a6a-cff3-412a-aefa-85d45ce86132" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:33:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:18 user nova-compute[75293]: DEBUG nova.compute.manager [req-d053b7b8-ff8c-4ac2-9cf4-76cf1ada5836 req-ea6033e3-d5fb-4fda-afd5-62bab334da7f service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Received event network-vif-unplugged-f788a7f8-c72b-45a6-b533-bba0a990e17a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:33:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d053b7b8-ff8c-4ac2-9cf4-76cf1ada5836 req-ea6033e3-d5fb-4fda-afd5-62bab334da7f service nova] Acquiring lock "19f93a6a-cff3-412a-aefa-85d45ce86132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d053b7b8-ff8c-4ac2-9cf4-76cf1ada5836 req-ea6033e3-d5fb-4fda-afd5-62bab334da7f service nova] Lock "19f93a6a-cff3-412a-aefa-85d45ce86132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:18 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-d053b7b8-ff8c-4ac2-9cf4-76cf1ada5836 req-ea6033e3-d5fb-4fda-afd5-62bab334da7f service nova] Lock "19f93a6a-cff3-412a-aefa-85d45ce86132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:18 user nova-compute[75293]: DEBUG nova.compute.manager [req-d053b7b8-ff8c-4ac2-9cf4-76cf1ada5836 req-ea6033e3-d5fb-4fda-afd5-62bab334da7f service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] No waiting events found dispatching network-vif-unplugged-f788a7f8-c72b-45a6-b533-bba0a990e17a {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:33:18 user nova-compute[75293]: WARNING nova.compute.manager [req-d053b7b8-ff8c-4ac2-9cf4-76cf1ada5836 req-ea6033e3-d5fb-4fda-afd5-62bab334da7f service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Received unexpected event network-vif-unplugged-f788a7f8-c72b-45a6-b533-bba0a990e17a for instance with vm_state active and task_state rescuing.
Nov 30 07:33:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:18 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:19 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Instance destroyed successfully.
Nov 30 07:33:19 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Attempting rescue
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75293) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Instance directory exists: not creating {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 30 07:33:19 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Creating image(s)
Nov 30 07:33:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Acquiring lock "/opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "/opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "/opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.objects.instance [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lazy-loading 'trusted_certs' on Instance uuid 19f93a6a-cff3-412a-aefa-85d45ce86132 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Acquiring lock "ef307a1514362657a23811e88c0aa968e5097fb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1 --force-share --output=json" returned: 0 in 0.186s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk.rescue {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ef307a1514362657a23811e88c0aa968e5097fb1,backing_fmt=raw /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk.rescue" returned: 0 in 0.057s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lock "ef307a1514362657a23811e88c0aa968e5097fb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.objects.instance [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lazy-loading 'migration_context' on Instance uuid 19f93a6a-cff3-412a-aefa-85d45ce86132 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.objects.base [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Object Instance<19f93a6a-cff3-412a-aefa-85d45ce86132> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Created local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Start _get_guest_xml network_info=[{"id": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "address": "fa:16:3e:66:a7:3e", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "vif_mac": "fa:16:3e:66:a7:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf788a7f8-c7", "ovs_interfaceid": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0546aff3-0862-4c77-a7b6-1bcd52baadc2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.objects.instance [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lazy-loading 'resources' on Instance uuid 19f93a6a-cff3-412a-aefa-85d45ce86132 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.objects.base [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Object Instance<19f93a6a-cff3-412a-aefa-85d45ce86132> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.objects.instance [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lazy-loading 'numa_topology' on Instance uuid 19f93a6a-cff3-412a-aefa-85d45ce86132 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.objects.base [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Object Instance<19f93a6a-cff3-412a-aefa-85d45ce86132> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:33:19 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:33:19 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-30T07:03:08Z,direct_url=<?>,disk_format='qcow2',id=0546aff3-0862-4c77-a7b6-1bcd52baadc2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='552643428120431f8bbeadca55f077de',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-30T07:03:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.objects.instance [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lazy-loading 'vcpu_model' on Instance uuid 19f93a6a-cff3-412a-aefa-85d45ce86132 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.objects.base [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Object Instance<19f93a6a-cff3-412a-aefa-85d45ce86132> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:31:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2108958473',display_name='tempest-ServerRescueNegativeTestJSON-server-2108958473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2108958473',id=46,image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-30T07:31:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66cd858197104635b10bf4248933da5a',ramdisk_id='',reservation_id='r-0fx8bm00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0546aff3-0862-4c77-a7b6-1bcd52baadc2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1533256171',owner_user_name='tempest-ServerRescueNegativeTestJSON-1533256171-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:31:35Z,user_data=None,user_id='8e97f2831a354c31a5c8b442a430e532',uuid=19f93a6a-cff3-412a-aefa-85d45ce86132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "address": "fa:16:3e:66:a7:3e", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "vif_mac": "fa:16:3e:66:a7:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf788a7f8-c7", "ovs_interfaceid": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Converting VIF {"id": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "address": "fa:16:3e:66:a7:3e", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "vif_mac": "fa:16:3e:66:a7:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf788a7f8-c7", "ovs_interfaceid": "f788a7f8-c72b-45a6-b533-bba0a990e17a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:a7:3e,bridge_name='br-int',has_traffic_filtering=True,id=f788a7f8-c72b-45a6-b533-bba0a990e17a,network=Network(889053dd-4bc3-435c-ac9f-751c7086044a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf788a7f8-c7') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.objects.instance [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Lazy-loading 'pci_devices' on Instance uuid 19f93a6a-cff3-412a-aefa-85d45ce86132 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.objects.base [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] Object Instance<19f93a6a-cff3-412a-aefa-85d45ce86132> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75293) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:33:19 user nova-compute[75293]:   <uuid>19f93a6a-cff3-412a-aefa-85d45ce86132</uuid>
Nov 30 07:33:19 user nova-compute[75293]:   <name>instance-0000002e</name>
Nov 30 07:33:19 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:33:19 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:33:19 user nova-compute[75293]:   <metadata>
Nov 30 07:33:19 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:33:19 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:33:19 user nova-compute[75293]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2108958473</nova:name>
Nov 30 07:33:19 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:33:19</nova:creationTime>
Nov 30 07:33:19 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:33:19 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:33:19 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:33:19 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:33:19 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:33:19 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:33:19 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:33:19 user nova-compute[75293]:       <nova:owner>
Nov 30 07:33:19 user nova-compute[75293]:         <nova:user uuid="8e97f2831a354c31a5c8b442a430e532">tempest-ServerRescueNegativeTestJSON-1533256171-project-member</nova:user>
Nov 30 07:33:19 user nova-compute[75293]:         <nova:project uuid="66cd858197104635b10bf4248933da5a">tempest-ServerRescueNegativeTestJSON-1533256171</nova:project>
Nov 30 07:33:19 user nova-compute[75293]:       </nova:owner>
Nov 30 07:33:19 user nova-compute[75293]:       <nova:root type="image" uuid="0546aff3-0862-4c77-a7b6-1bcd52baadc2"/>
Nov 30 07:33:19 user nova-compute[75293]:       <nova:ports>
Nov 30 07:33:19 user nova-compute[75293]:         <nova:port uuid="f788a7f8-c72b-45a6-b533-bba0a990e17a">
Nov 30 07:33:19 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 30 07:33:19 user nova-compute[75293]:         </nova:port>
Nov 30 07:33:19 user nova-compute[75293]:       </nova:ports>
Nov 30 07:33:19 user nova-compute[75293]:     </nova:instance>
Nov 30 07:33:19 user nova-compute[75293]:   </metadata>
Nov 30 07:33:19 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:33:19 user nova-compute[75293]:     <system>
Nov 30 07:33:19 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:33:19 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:33:19 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:33:19 user nova-compute[75293]:       <entry name="serial">19f93a6a-cff3-412a-aefa-85d45ce86132</entry>
Nov 30 07:33:19 user nova-compute[75293]:       <entry name="uuid">19f93a6a-cff3-412a-aefa-85d45ce86132</entry>
Nov 30 07:33:19 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:33:19 user nova-compute[75293]:     </system>
Nov 30 07:33:19 user nova-compute[75293]:   </sysinfo>
Nov 30 07:33:19 user nova-compute[75293]:   <os>
Nov 30 07:33:19 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:33:19 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:33:19 user nova-compute[75293]:   </os>
Nov 30 07:33:19 user nova-compute[75293]:   <features>
Nov 30 07:33:19 user nova-compute[75293]:     <acpi/>
Nov 30 07:33:19 user nova-compute[75293]:     <apic/>
Nov 30 07:33:19 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:33:19 user nova-compute[75293]:   </features>
Nov 30 07:33:19 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:33:19 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:33:19 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:33:19 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:33:19 user nova-compute[75293]:   </clock>
Nov 30 07:33:19 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:33:19 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:33:19 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:33:19 user nova-compute[75293]:   </cpu>
Nov 30 07:33:19 user nova-compute[75293]:   <devices>
Nov 30 07:33:19 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:33:19 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:33:19 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk.rescue"/>
Nov 30 07:33:19 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:33:19 user nova-compute[75293]:     </disk>
Nov 30 07:33:19 user nova-compute[75293]:     <disk type="file" device="disk">
Nov 30 07:33:19 user nova-compute[75293]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 30 07:33:19 user nova-compute[75293]:       <source file="/opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk"/>
Nov 30 07:33:19 user nova-compute[75293]:       <target dev="vdb" bus="virtio"/>
Nov 30 07:33:19 user nova-compute[75293]:     </disk>
Nov 30 07:33:19 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:33:19 user nova-compute[75293]:       <mac address="fa:16:3e:66:a7:3e"/>
Nov 30 07:33:19 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:33:19 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:33:19 user nova-compute[75293]:       <target dev="tapf788a7f8-c7"/>
Nov 30 07:33:19 user nova-compute[75293]:     </interface>
Nov 30 07:33:19 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:33:19 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/console.log" append="off"/>
Nov 30 07:33:19 user nova-compute[75293]:     </serial>
Nov 30 07:33:19 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:33:19 user nova-compute[75293]:     <video>
Nov 30 07:33:19 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:33:19 user nova-compute[75293]:     </video>
Nov 30 07:33:19 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:33:19 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:33:19 user nova-compute[75293]:     </rng>
Nov 30 07:33:19 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:33:19 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:33:19 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:33:19 user nova-compute[75293]:     </memballoon>
Nov 30 07:33:19 user nova-compute[75293]:   </devices>
Nov 30 07:33:19 user nova-compute[75293]: </domain>
Nov 30 07:33:19 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:33:19 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Instance destroyed successfully.
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:33:19 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] No VIF found with MAC fa:16:3e:66:a7:3e, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:33:20 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:33:21 user nova-compute[75293]: DEBUG nova.compute.manager [req-9191cd25-4c83-439c-b3a8-2d2d09c2e1f4 req-cd4a6682-fa59-4c42-830f-c8b3659ed1be service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Received event network-vif-plugged-f788a7f8-c72b-45a6-b533-bba0a990e17a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:33:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9191cd25-4c83-439c-b3a8-2d2d09c2e1f4 req-cd4a6682-fa59-4c42-830f-c8b3659ed1be service nova] Acquiring lock "19f93a6a-cff3-412a-aefa-85d45ce86132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9191cd25-4c83-439c-b3a8-2d2d09c2e1f4 req-cd4a6682-fa59-4c42-830f-c8b3659ed1be service nova] Lock "19f93a6a-cff3-412a-aefa-85d45ce86132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:21 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-9191cd25-4c83-439c-b3a8-2d2d09c2e1f4 req-cd4a6682-fa59-4c42-830f-c8b3659ed1be service nova] Lock "19f93a6a-cff3-412a-aefa-85d45ce86132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:21 user nova-compute[75293]: DEBUG nova.compute.manager [req-9191cd25-4c83-439c-b3a8-2d2d09c2e1f4 req-cd4a6682-fa59-4c42-830f-c8b3659ed1be service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] No waiting events found dispatching network-vif-plugged-f788a7f8-c72b-45a6-b533-bba0a990e17a {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:33:21 user nova-compute[75293]: WARNING nova.compute.manager [req-9191cd25-4c83-439c-b3a8-2d2d09c2e1f4 req-cd4a6682-fa59-4c42-830f-c8b3659ed1be service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Received unexpected event network-vif-plugged-f788a7f8-c72b-45a6-b533-bba0a990e17a for instance with vm_state active and task_state rescuing.
Nov 30 07:33:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:21 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:23 user nova-compute[75293]: DEBUG nova.compute.manager [req-1bf46f72-9146-47b8-a7d5-5f3b5571f1c6 req-680473b9-9fd5-4df5-9d15-f6284e703345 service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Received event network-vif-plugged-f788a7f8-c72b-45a6-b533-bba0a990e17a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:33:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1bf46f72-9146-47b8-a7d5-5f3b5571f1c6 req-680473b9-9fd5-4df5-9d15-f6284e703345 service nova] Acquiring lock "19f93a6a-cff3-412a-aefa-85d45ce86132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1bf46f72-9146-47b8-a7d5-5f3b5571f1c6 req-680473b9-9fd5-4df5-9d15-f6284e703345 service nova] Lock "19f93a6a-cff3-412a-aefa-85d45ce86132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1bf46f72-9146-47b8-a7d5-5f3b5571f1c6 req-680473b9-9fd5-4df5-9d15-f6284e703345 service nova] Lock "19f93a6a-cff3-412a-aefa-85d45ce86132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:23 user nova-compute[75293]: DEBUG nova.compute.manager [req-1bf46f72-9146-47b8-a7d5-5f3b5571f1c6 req-680473b9-9fd5-4df5-9d15-f6284e703345 service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] No waiting events found dispatching network-vif-plugged-f788a7f8-c72b-45a6-b533-bba0a990e17a {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:33:23 user nova-compute[75293]: WARNING nova.compute.manager [req-1bf46f72-9146-47b8-a7d5-5f3b5571f1c6 req-680473b9-9fd5-4df5-9d15-f6284e703345 service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Received unexpected event network-vif-plugged-f788a7f8-c72b-45a6-b533-bba0a990e17a for instance with vm_state active and task_state rescuing.
Nov 30 07:33:23 user nova-compute[75293]: DEBUG nova.compute.manager [req-1bf46f72-9146-47b8-a7d5-5f3b5571f1c6 req-680473b9-9fd5-4df5-9d15-f6284e703345 service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Received event network-vif-plugged-f788a7f8-c72b-45a6-b533-bba0a990e17a {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:33:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1bf46f72-9146-47b8-a7d5-5f3b5571f1c6 req-680473b9-9fd5-4df5-9d15-f6284e703345 service nova] Acquiring lock "19f93a6a-cff3-412a-aefa-85d45ce86132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1bf46f72-9146-47b8-a7d5-5f3b5571f1c6 req-680473b9-9fd5-4df5-9d15-f6284e703345 service nova] Lock "19f93a6a-cff3-412a-aefa-85d45ce86132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:23 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-1bf46f72-9146-47b8-a7d5-5f3b5571f1c6 req-680473b9-9fd5-4df5-9d15-f6284e703345 service nova] Lock "19f93a6a-cff3-412a-aefa-85d45ce86132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:23 user nova-compute[75293]: DEBUG nova.compute.manager [req-1bf46f72-9146-47b8-a7d5-5f3b5571f1c6 req-680473b9-9fd5-4df5-9d15-f6284e703345 service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] No waiting events found dispatching network-vif-plugged-f788a7f8-c72b-45a6-b533-bba0a990e17a {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:33:23 user nova-compute[75293]: WARNING nova.compute.manager [req-1bf46f72-9146-47b8-a7d5-5f3b5571f1c6 req-680473b9-9fd5-4df5-9d15-f6284e703345 service nova] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Received unexpected event network-vif-plugged-f788a7f8-c72b-45a6-b533-bba0a990e17a for instance with vm_state active and task_state rescuing.
Nov 30 07:33:23 user nova-compute[75293]: DEBUG nova.compute.manager [None req-035966ab-7683-4221-b60a-0428afef3bf2 tempest-ServerRescueNegativeTestJSON-1533256171 tempest-ServerRescueNegativeTestJSON-1533256171-project-member] [instance: 19f93a6a-cff3-412a-aefa-85d45ce86132] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Start spawning the instance on the hypervisor. {{(pid=75293) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Creating instance directory {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 30 07:33:25 user nova-compute[75293]: INFO nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Creating image(s)
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Did not create local disks {{(pid=75293) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Ensure instance console log exists: /opt/stack/data/nova/instances/75ab4c21-badd-4aaf-8dab-da3c6ab84d46/console.log {{(pid=75293) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Start _get_guest_xml network_info=[{"id": "f7c2846c-289f-42c1-a924-8deac18f3d32", "address": "fa:16:3e:7b:bb:62", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c2846c-28", "ovs_interfaceid": "f7c2846c-289f-42c1-a924-8deac18f3d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvFEBmco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '75ab4c21-badd-4aaf-8dab-da3c6ab84d46', 'attached_at': '', 'detached_at': '', 'volume_id': '3b0b2927-e7ca-4b73-baf1-9d4c51b46dff', 'serial': '3b0b2927-e7ca-4b73-baf1-9d4c51b46dff'}, 'delete_on_termination': False, 'attachment_id': 'b5585824-90b4-43a0-8672-1c29dfe78dda', 'volume_type': None} {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 30 07:33:25 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:33:25 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] CPU controller missing on host. {{(pid=75293) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.host [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] CPU controller found on host. {{(pid=75293) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75293) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-30T07:02:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Flavor limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Image limits 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Flavor pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Image pref 0:0:0 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Got 1 possible topologies {{(pid=75293) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.hardware [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75293) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Calling os-brick to attach iSCSI Volume {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7effe80b9420>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvFEBmco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 30 07:33:25 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:33:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:33:25 user nova-compute[75293]: WARNING os_brick.initiator.connectors.base [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 30 07:33:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 30 07:33:25 user nova-compute[75293]: INFO os_brick.initiator.connectors.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed70022f-9f6c-4b5b-9b73-02917b2b6b07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 30 07:33:25 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --interface default --op new {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[937996ec-85d2-40a3-9df1-15ed23d25761]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff] added\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff] added
Nov 30 07:33:25 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eaf73fc-459a-49cb-80fc-acdc46dbd41f]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44a4b4e-2f28-4cc1-8675-141754795bf0]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvFEBmco {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvFEBmco" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecf781e-b1fa-4361-b1d5-48a07578a192]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MvFEBmco'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[88880bf1-ef07-4776-a9c5-ee018e7d7850]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b8d954-6348-4a44-8ea3-f454d4b1841c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 30 07:33:25 user nova-compute[75293]:  {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:33:25 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 30 07:33:25 user nova-compute[75293]:  {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:33:25 user nova-compute[75293]: WARNING os_brick.initiator.connectors.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 30 07:33:25 user nova-compute[75293]: 
Nov 30 07:33:25 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --login {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[642701cc-926f-4cae-9554-0833c523f6c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff, portal: 172.16.0.220,3260]
Nov 30 07:33:26 user nova-compute[75293]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff, portal: 172.16.0.220,3260] successful.
Nov 30 07:33:26 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[f441beeb-b211-40d2-a4dd-62426a57ca1c]: (4, ('', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75293) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[e069bd1c-c6b1-4177-96cf-03139163a4ef]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff (non-flash)\n', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff (non-flash)
Nov 30 07:33:26 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff (non-flash)
Nov 30 07:33:26 user nova-compute[75293]:  stderr= {{(pid=75293) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Connected to 172.16.0.220:3260 {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75293) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75293) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86417) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG oslo.privsep.daemon [-] privsep: reply[0036c521-e16f-4629-8afb-2ad40251f91b]: (4, ('- - 0', '')) {{(pid=86417) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG os_brick.initiator.linuxscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75293) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3b0b2927-e7ca-4b73-baf1-9d4c51b46dff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvFEBmco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75293) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:26 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.base [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '26234373535356533', 'path': '/dev/sdb'} {{(pid=75293) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234373535356533', 'path': '/dev/sdb'} {{(pid=75293) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:33:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-189161255',display_name='tempest-TestVolumeBootPattern-server-189161255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-189161255',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjYpNawIGYigccNKqOMu5B2KkHiW6PJtAwx4gnV2Bz3ppJhyMPL2myvnkPDsvqitKRsm9L8h5UrColCNNTtOYkZ/lhfNHFXjjmmY5PKfn3zACvSADMpOWwtUHdyXG+/2Q==',key_name='tempest-TestVolumeBootPattern-112031280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4bfa84ea3874ba7ac0af4c3b1d2f918',ramdisk_id='',reservation_id='r-vy0lzgtp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273596612',owner_user_name='tempest-TestVolumeBootPattern-273596612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:33:14Z,user_data=None,user_id='fbee62d1b15144cc9d433a4a64dd12a7',uuid=75ab4c21-badd-4aaf-8dab-da3c6ab84d46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7c2846c-289f-42c1-a924-8deac18f3d32", "address": "fa:16:3e:7b:bb:62", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c2846c-28", "ovs_interfaceid": "f7c2846c-289f-42c1-a924-8deac18f3d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75293) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converting VIF {"id": "f7c2846c-289f-42c1-a924-8deac18f3d32", "address": "fa:16:3e:7b:bb:62", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c2846c-28", "ovs_interfaceid": "f7c2846c-289f-42c1-a924-8deac18f3d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:bb:62,bridge_name='br-int',has_traffic_filtering=True,id=f7c2846c-289f-42c1-a924-8deac18f3d32,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7c2846c-28') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG nova.objects.instance [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lazy-loading 'pci_devices' on Instance uuid 75ab4c21-badd-4aaf-8dab-da3c6ab84d46 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] End _get_guest_xml xml=<domain type="kvm">
Nov 30 07:33:27 user nova-compute[75293]:   <uuid>75ab4c21-badd-4aaf-8dab-da3c6ab84d46</uuid>
Nov 30 07:33:27 user nova-compute[75293]:   <name>instance-00000030</name>
Nov 30 07:33:27 user nova-compute[75293]:   <memory>524288</memory>
Nov 30 07:33:27 user nova-compute[75293]:   <vcpu>1</vcpu>
Nov 30 07:33:27 user nova-compute[75293]:   <metadata>
Nov 30 07:33:27 user nova-compute[75293]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 30 07:33:27 user nova-compute[75293]:       <nova:package version="0.0.0"/>
Nov 30 07:33:27 user nova-compute[75293]:       <nova:name>tempest-TestVolumeBootPattern-server-189161255</nova:name>
Nov 30 07:33:27 user nova-compute[75293]:       <nova:creationTime>2023-11-30 07:33:25</nova:creationTime>
Nov 30 07:33:27 user nova-compute[75293]:       <nova:flavor name="m1.tiny">
Nov 30 07:33:27 user nova-compute[75293]:         <nova:memory>512</nova:memory>
Nov 30 07:33:27 user nova-compute[75293]:         <nova:disk>1</nova:disk>
Nov 30 07:33:27 user nova-compute[75293]:         <nova:swap>0</nova:swap>
Nov 30 07:33:27 user nova-compute[75293]:         <nova:ephemeral>0</nova:ephemeral>
Nov 30 07:33:27 user nova-compute[75293]:         <nova:vcpus>1</nova:vcpus>
Nov 30 07:33:27 user nova-compute[75293]:       </nova:flavor>
Nov 30 07:33:27 user nova-compute[75293]:       <nova:owner>
Nov 30 07:33:27 user nova-compute[75293]:         <nova:user uuid="fbee62d1b15144cc9d433a4a64dd12a7">tempest-TestVolumeBootPattern-273596612-project-member</nova:user>
Nov 30 07:33:27 user nova-compute[75293]:         <nova:project uuid="e4bfa84ea3874ba7ac0af4c3b1d2f918">tempest-TestVolumeBootPattern-273596612</nova:project>
Nov 30 07:33:27 user nova-compute[75293]:       </nova:owner>
Nov 30 07:33:27 user nova-compute[75293]:       <nova:ports>
Nov 30 07:33:27 user nova-compute[75293]:         <nova:port uuid="f7c2846c-289f-42c1-a924-8deac18f3d32">
Nov 30 07:33:27 user nova-compute[75293]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 30 07:33:27 user nova-compute[75293]:         </nova:port>
Nov 30 07:33:27 user nova-compute[75293]:       </nova:ports>
Nov 30 07:33:27 user nova-compute[75293]:     </nova:instance>
Nov 30 07:33:27 user nova-compute[75293]:   </metadata>
Nov 30 07:33:27 user nova-compute[75293]:   <sysinfo type="smbios">
Nov 30 07:33:27 user nova-compute[75293]:     <system>
Nov 30 07:33:27 user nova-compute[75293]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 30 07:33:27 user nova-compute[75293]:       <entry name="product">OpenStack Nova</entry>
Nov 30 07:33:27 user nova-compute[75293]:       <entry name="version">0.0.0</entry>
Nov 30 07:33:27 user nova-compute[75293]:       <entry name="serial">75ab4c21-badd-4aaf-8dab-da3c6ab84d46</entry>
Nov 30 07:33:27 user nova-compute[75293]:       <entry name="uuid">75ab4c21-badd-4aaf-8dab-da3c6ab84d46</entry>
Nov 30 07:33:27 user nova-compute[75293]:       <entry name="family">Virtual Machine</entry>
Nov 30 07:33:27 user nova-compute[75293]:     </system>
Nov 30 07:33:27 user nova-compute[75293]:   </sysinfo>
Nov 30 07:33:27 user nova-compute[75293]:   <os>
Nov 30 07:33:27 user nova-compute[75293]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 30 07:33:27 user nova-compute[75293]:     <boot dev="hd"/>
Nov 30 07:33:27 user nova-compute[75293]:     <smbios mode="sysinfo"/>
Nov 30 07:33:27 user nova-compute[75293]:   </os>
Nov 30 07:33:27 user nova-compute[75293]:   <features>
Nov 30 07:33:27 user nova-compute[75293]:     <acpi/>
Nov 30 07:33:27 user nova-compute[75293]:     <apic/>
Nov 30 07:33:27 user nova-compute[75293]:     <vmcoreinfo/>
Nov 30 07:33:27 user nova-compute[75293]:   </features>
Nov 30 07:33:27 user nova-compute[75293]:   <clock offset="utc">
Nov 30 07:33:27 user nova-compute[75293]:     <timer name="pit" tickpolicy="delay"/>
Nov 30 07:33:27 user nova-compute[75293]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 30 07:33:27 user nova-compute[75293]:     <timer name="hpet" present="no"/>
Nov 30 07:33:27 user nova-compute[75293]:   </clock>
Nov 30 07:33:27 user nova-compute[75293]:   <cpu mode="custom" match="exact">
Nov 30 07:33:27 user nova-compute[75293]:     <model>Nehalem</model>
Nov 30 07:33:27 user nova-compute[75293]:     <topology sockets="1" cores="1" threads="1"/>
Nov 30 07:33:27 user nova-compute[75293]:   </cpu>
Nov 30 07:33:27 user nova-compute[75293]:   <devices>
Nov 30 07:33:27 user nova-compute[75293]:     <disk type="block" device="disk">
Nov 30 07:33:27 user nova-compute[75293]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 30 07:33:27 user nova-compute[75293]:       <source dev="/dev/sdb"/>
Nov 30 07:33:27 user nova-compute[75293]:       <target dev="vda" bus="virtio"/>
Nov 30 07:33:27 user nova-compute[75293]:       <serial>3b0b2927-e7ca-4b73-baf1-9d4c51b46dff</serial>
Nov 30 07:33:27 user nova-compute[75293]:     </disk>
Nov 30 07:33:27 user nova-compute[75293]:     <interface type="ethernet">
Nov 30 07:33:27 user nova-compute[75293]:       <mac address="fa:16:3e:7b:bb:62"/>
Nov 30 07:33:27 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:33:27 user nova-compute[75293]:       <mtu size="1442"/>
Nov 30 07:33:27 user nova-compute[75293]:       <target dev="tapf7c2846c-28"/>
Nov 30 07:33:27 user nova-compute[75293]:     </interface>
Nov 30 07:33:27 user nova-compute[75293]:     <serial type="pty">
Nov 30 07:33:27 user nova-compute[75293]:       <log file="/opt/stack/data/nova/instances/75ab4c21-badd-4aaf-8dab-da3c6ab84d46/console.log" append="off"/>
Nov 30 07:33:27 user nova-compute[75293]:     </serial>
Nov 30 07:33:27 user nova-compute[75293]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 30 07:33:27 user nova-compute[75293]:     <video>
Nov 30 07:33:27 user nova-compute[75293]:       <model type="virtio"/>
Nov 30 07:33:27 user nova-compute[75293]:     </video>
Nov 30 07:33:27 user nova-compute[75293]:     <rng model="virtio">
Nov 30 07:33:27 user nova-compute[75293]:       <backend model="random">/dev/urandom</backend>
Nov 30 07:33:27 user nova-compute[75293]:     </rng>
Nov 30 07:33:27 user nova-compute[75293]:     <controller type="usb" index="0" model="none"/>
Nov 30 07:33:27 user nova-compute[75293]:     <memballoon model="virtio">
Nov 30 07:33:27 user nova-compute[75293]:       <stats period="10"/>
Nov 30 07:33:27 user nova-compute[75293]:     </memballoon>
Nov 30 07:33:27 user nova-compute[75293]:   </devices>
Nov 30 07:33:27 user nova-compute[75293]: </domain>
Nov 30 07:33:27 user nova-compute[75293]:  {{(pid=75293) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.vif [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-30T07:33:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-189161255',display_name='tempest-TestVolumeBootPattern-server-189161255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-189161255',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjYpNawIGYigccNKqOMu5B2KkHiW6PJtAwx4gnV2Bz3ppJhyMPL2myvnkPDsvqitKRsm9L8h5UrColCNNTtOYkZ/lhfNHFXjjmmY5PKfn3zACvSADMpOWwtUHdyXG+/2Q==',key_name='tempest-TestVolumeBootPattern-112031280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4bfa84ea3874ba7ac0af4c3b1d2f918',ramdisk_id='',reservation_id='r-vy0lzgtp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273596612',owner_user_name='tempest-TestVolumeBootPattern-273596612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-30T07:33:14Z,user_data=None,user_id='fbee62d1b15144cc9d433a4a64dd12a7',uuid=75ab4c21-badd-4aaf-8dab-da3c6ab84d46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7c2846c-289f-42c1-a924-8deac18f3d32", "address": "fa:16:3e:7b:bb:62", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c2846c-28", "ovs_interfaceid": "f7c2846c-289f-42c1-a924-8deac18f3d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converting VIF {"id": "f7c2846c-289f-42c1-a924-8deac18f3d32", "address": "fa:16:3e:7b:bb:62", "network": {"id": "d0eda455-9153-4323-be89-04f41067fe6b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1560405000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4bfa84ea3874ba7ac0af4c3b1d2f918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c2846c-28", "ovs_interfaceid": "f7c2846c-289f-42c1-a924-8deac18f3d32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG nova.network.os_vif_util [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:bb:62,bridge_name='br-int',has_traffic_filtering=True,id=f7c2846c-289f-42c1-a924-8deac18f3d32,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7c2846c-28') {{(pid=75293) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG os_vif [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:bb:62,bridge_name='br-int',has_traffic_filtering=True,id=f7c2846c-289f-42c1-a924-8deac18f3d32,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7c2846c-28') {{(pid=75293) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e482e0d9-02eb-5623-95f9-c4217c237b33', '_type': 'linux-noop'}}, row=False) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7c2846c-28, may_exist=True, interface_attrs={}) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7c2846c-28, col_values=(('qos', UUID('efb54533-b126-42de-b4bd-974bd5c3198e')),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7c2846c-28, col_values=(('external_ids', {'iface-id': 'f7c2846c-289f-42c1-a924-8deac18f3d32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:bb:62', 'vm-uuid': '75ab4c21-badd-4aaf-8dab-da3c6ab84d46'}),), if_exists=True) {{(pid=75293) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:27 user nova-compute[75293]: INFO os_vif [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:bb:62,bridge_name='br-int',has_traffic_filtering=True,id=f7c2846c-289f-42c1-a924-8deac18f3d32,network=Network(d0eda455-9153-4323-be89-04f41067fe6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7c2846c-28')
Nov 30 07:33:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] No BDM found with device name vda, not building metadata. {{(pid=75293) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 30 07:33:27 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] No VIF found with MAC fa:16:3e:7b:bb:62, not building metadata {{(pid=75293) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 30 07:33:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:28 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-6cef4372-8a59-4258-a036-1fd30b62432b req-fe18e7e2-024f-4a0a-8f62-b81da90b55ad service nova] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Received event network-vif-plugged-f7c2846c-289f-42c1-a924-8deac18f3d32 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:33:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6cef4372-8a59-4258-a036-1fd30b62432b req-fe18e7e2-024f-4a0a-8f62-b81da90b55ad service nova] Acquiring lock "75ab4c21-badd-4aaf-8dab-da3c6ab84d46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6cef4372-8a59-4258-a036-1fd30b62432b req-fe18e7e2-024f-4a0a-8f62-b81da90b55ad service nova] Lock "75ab4c21-badd-4aaf-8dab-da3c6ab84d46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:29 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-6cef4372-8a59-4258-a036-1fd30b62432b req-fe18e7e2-024f-4a0a-8f62-b81da90b55ad service nova] Lock "75ab4c21-badd-4aaf-8dab-da3c6ab84d46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:29 user nova-compute[75293]: DEBUG nova.compute.manager [req-6cef4372-8a59-4258-a036-1fd30b62432b req-fe18e7e2-024f-4a0a-8f62-b81da90b55ad service nova] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] No waiting events found dispatching network-vif-plugged-f7c2846c-289f-42c1-a924-8deac18f3d32 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:33:29 user nova-compute[75293]: WARNING nova.compute.manager [req-6cef4372-8a59-4258-a036-1fd30b62432b req-fe18e7e2-024f-4a0a-8f62-b81da90b55ad service nova] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Received unexpected event network-vif-plugged-f7c2846c-289f-42c1-a924-8deac18f3d32 for instance with vm_state building and task_state spawning.
Nov 30 07:33:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:29 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:30 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Instance event wait completed in 0 seconds for  {{(pid=75293) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 30 07:33:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Guest created on hypervisor {{(pid=75293) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 30 07:33:30 user nova-compute[75293]: INFO nova.virt.libvirt.driver [-] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Instance spawned successfully.
Nov 30 07:33:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 30 07:33:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Found default for hw_cdrom_bus of ide {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:33:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Found default for hw_disk_bus of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:33:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Found default for hw_input_bus of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:33:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Found default for hw_pointer_model of None {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:33:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Found default for hw_video_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:33:30 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Found default for hw_vif_model of virtio {{(pid=75293) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 30 07:33:30 user nova-compute[75293]: INFO nova.compute.manager [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 30 07:33:30 user nova-compute[75293]: DEBUG nova.compute.manager [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Checking state {{(pid=75293) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 30 07:33:31 user nova-compute[75293]: INFO nova.compute.manager [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Took 17.64 seconds to build instance.
Nov 30 07:33:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-6c3d255f-f0ca-4e1f-91cb-b07990ba2417 tempest-TestVolumeBootPattern-273596612 tempest-TestVolumeBootPattern-273596612-project-member] Lock "75ab4c21-badd-4aaf-8dab-da3c6ab84d46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.755s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:31 user nova-compute[75293]: DEBUG nova.compute.manager [req-974d5bce-6bb2-4385-86a6-ca4653968a2e req-86e14172-249c-4792-876d-07b8f9e267bd service nova] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Received event network-vif-plugged-f7c2846c-289f-42c1-a924-8deac18f3d32 {{(pid=75293) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 30 07:33:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-974d5bce-6bb2-4385-86a6-ca4653968a2e req-86e14172-249c-4792-876d-07b8f9e267bd service nova] Acquiring lock "75ab4c21-badd-4aaf-8dab-da3c6ab84d46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-974d5bce-6bb2-4385-86a6-ca4653968a2e req-86e14172-249c-4792-876d-07b8f9e267bd service nova] Lock "75ab4c21-badd-4aaf-8dab-da3c6ab84d46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:31 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [req-974d5bce-6bb2-4385-86a6-ca4653968a2e req-86e14172-249c-4792-876d-07b8f9e267bd service nova] Lock "75ab4c21-badd-4aaf-8dab-da3c6ab84d46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:31 user nova-compute[75293]: DEBUG nova.compute.manager [req-974d5bce-6bb2-4385-86a6-ca4653968a2e req-86e14172-249c-4792-876d-07b8f9e267bd service nova] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] No waiting events found dispatching network-vif-plugged-f7c2846c-289f-42c1-a924-8deac18f3d32 {{(pid=75293) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 30 07:33:31 user nova-compute[75293]: WARNING nova.compute.manager [req-974d5bce-6bb2-4385-86a6-ca4653968a2e req-86e14172-249c-4792-876d-07b8f9e267bd service nova] [instance: 75ab4c21-badd-4aaf-8dab-da3c6ab84d46] Received unexpected event network-vif-plugged-f7c2846c-289f-42c1-a924-8deac18f3d32 for instance with vm_state active and task_state None.
Nov 30 07:33:31 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:32 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:36 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:37 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:41 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:42 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:46 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:47 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:51 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:52 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:54 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._sync_power_states {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:33:54 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Triggering sync for uuid 23bca083-fc9b-439b-9c5d-463c1187a5d5 {{(pid=75293) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 07:33:54 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Triggering sync for uuid 19f93a6a-cff3-412a-aefa-85d45ce86132 {{(pid=75293) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 07:33:54 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Triggering sync for uuid fe9edc76-b8b7-4bf1-9f44-513624f4d1ea {{(pid=75293) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 07:33:54 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Triggering sync for uuid 75ab4c21-badd-4aaf-8dab-da3c6ab84d46 {{(pid=75293) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 30 07:33:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "23bca083-fc9b-439b-9c5d-463c1187a5d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "23bca083-fc9b-439b-9c5d-463c1187a5d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "19f93a6a-cff3-412a-aefa-85d45ce86132" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "19f93a6a-cff3-412a-aefa-85d45ce86132" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "fe9edc76-b8b7-4bf1-9f44-513624f4d1ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "fe9edc76-b8b7-4bf1-9f44-513624f4d1ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "75ab4c21-badd-4aaf-8dab-da3c6ab84d46" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:33:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "75ab4c21-badd-4aaf-8dab-da3c6ab84d46" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:33:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "19f93a6a-cff3-412a-aefa-85d45ce86132" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "fe9edc76-b8b7-4bf1-9f44-513624f4d1ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "75ab4c21-badd-4aaf-8dab-da3c6ab84d46" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:54 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "23bca083-fc9b-439b-9c5d-463c1187a5d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:33:56 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:33:57 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:34:01 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:34:02 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 30 07:34:05 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:34:05 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:34:05 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75293) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 30 07:34:06 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:34:07 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:34:07 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:34:09 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:34:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:34:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:34:09 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:34:09 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Auditing locally available compute resources for user (node: user) {{(pid=75293) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 30 07:34:09 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe9edc76-b8b7-4bf1-9f44-513624f4d1ea/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:34:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe9edc76-b8b7-4bf1-9f44-513624f4d1ea/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:34:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe9edc76-b8b7-4bf1-9f44-513624f4d1ea/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:34:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe9edc76-b8b7-4bf1-9f44-513624f4d1ea/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:34:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk.rescue --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:34:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:34:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk.rescue --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:34:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:34:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:34:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:34:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:34:10 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19f93a6a-cff3-412a-aefa-85d45ce86132/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:34:11 user nova-compute[75293]: DEBUG nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75293) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 30 07:34:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:34:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:34:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk --force-share --output=json {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 30 07:34:11 user nova-compute[75293]: DEBUG oslo_concurrency.processutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23bca083-fc9b-439b-9c5d-463c1187a5d5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75293) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 30 07:34:11 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:34:11 user nova-compute[75293]: WARNING nova.virt.libvirt.driver [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 30 07:34:11 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Hypervisor/Node resource view: name=user free_ram=8528MB free_disk=25.05469512939453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75293) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 30 07:34:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 30 07:34:11 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 30 07:34:11 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 23bca083-fc9b-439b-9c5d-463c1187a5d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:34:11 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 19f93a6a-cff3-412a-aefa-85d45ce86132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:34:11 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance fe9edc76-b8b7-4bf1-9f44-513624f4d1ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:34:11 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Instance 75ab4c21-badd-4aaf-8dab-da3c6ab84d46 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75293) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 30 07:34:11 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 30 07:34:11 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75293) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 30 07:34:12 user nova-compute[75293]: DEBUG nova.compute.provider_tree [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed in ProviderTree for provider: 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa {{(pid=75293) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 30 07:34:12 user nova-compute[75293]: DEBUG nova.scheduler.client.report [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Inventory has not changed for provider 82d797f6-1f8a-4ad9-a185-f23ce9a5cdaa based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75293) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 30 07:34:12 user nova-compute[75293]: DEBUG nova.compute.resource_tracker [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Compute_service record updated for user:user {{(pid=75293) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 30 07:34:12 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=75293) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 30 07:34:12 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 30 07:34:13 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:34:13 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:34:14 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:34:15 user nova-compute[75293]: DEBUG oslo_service.periodic_task [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75293) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 30 07:34:15 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Starting heal instance info cache {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 30 07:34:15 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Rebuilding the list of instances to heal {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 30 07:34:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquiring lock "refresh_cache-23bca083-fc9b-439b-9c5d-463c1187a5d5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 30 07:34:15 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Acquired lock "refresh_cache-23bca083-fc9b-439b-9c5d-463c1187a5d5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 30 07:34:15 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Forcefully refreshing network info cache for instance {{(pid=75293) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 30 07:34:15 user nova-compute[75293]: DEBUG nova.objects.instance [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Lazy-loading 'info_cache' on Instance uuid 23bca083-fc9b-439b-9c5d-463c1187a5d5 {{(pid=75293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 30 07:34:16 user nova-compute[75293]: DEBUG nova.network.neutron [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Updating instance_info_cache with network_info: [{"id": "98525ae2-e80f-4cb1-a222-426e315e26d1", "address": "fa:16:3e:92:8f:c2", "network": {"id": "889053dd-4bc3-435c-ac9f-751c7086044a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-708365170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66cd858197104635b10bf4248933da5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98525ae2-e8", "ovs_interfaceid": "98525ae2-e80f-4cb1-a222-426e315e26d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75293) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 30 07:34:16 user nova-compute[75293]: DEBUG oslo_concurrency.lockutils [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] Releasing lock "refresh_cache-23bca083-fc9b-439b-9c5d-463c1187a5d5" {{(pid=75293) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 30 07:34:16 user nova-compute[75293]: DEBUG nova.compute.manager [None req-8456c829-d095-4a7a-9663-003e0a70c75a None None] [instance: 23bca083-fc9b-439b-9c5d-463c1187a5d5] Updated the network info_cache for instance {{(pid=75293) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 30 07:34:17 user nova-compute[75293]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75293) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}